Skip to content
sayak.webdesignerWeb · Software · Data · AI
Data Engineering

The Ultimate Guide to Data Aggregation for the Solar Industry

A 50 MW plant running two per cent below its achievable performance ratio is losing a substantial annual sum — and the cause is almost never the whole plant. It is a specific set of strings.

Sayak Web Designer · Data Engineering Practice 2 July 2026 13 min read
PV STRINGS — 42,000 modulesString invertersMPPT, 1,240 unitsWeather stationGHI · POA · tempSCADA gatewayModbus → MQTTPerformance Ratiolive PR vs contractualSoiling / shading lossper-string attributionGeneration forecastD+1 for schedulingToday · 18.4 MWhDGR automatedPPA compliance pack

Solar is unusually well instrumented and unusually badly analysed. Irradiance, module temperature, string current, inverter output and export metering are all measured from commissioning day. Most asset owners see a daily generation figure and a monthly performance ratio — one of which tells you nothing about where a problem is, and the other of which is a contractual metric rather than an operational one.

The gap between those and a genuinely actionable view is data aggregation done properly. This guide covers the decisions that determine whether that aggregation produces something an O&M team can act on, drawn from the plants and portfolios we monitor.

01

What you are actually aggregating

Four streams, each with different characteristics. Inverter and string telemetry: high volume, high cardinality, the source of nearly all loss attribution. Weather station data: low volume, high importance, because nothing can be normalised without plane-of-array irradiance and module temperature. Meter data: low volume, high authority, because this is what gets invoiced. And event data: alarms, trips, curtailment signals and maintenance records, which explain the gaps in everything else.

The most common mistake is treating these as one stream. They have different resolutions, different reliability and different roles. Meter data is the commercial truth and must reconcile exactly; inverter telemetry is diagnostic and can tolerate occasional gaps; weather data without gap-filling makes normalisation unreliable for the affected period, which must be marked rather than silently interpolated.

In practice

Inverter and string telemetry — the diagnostic layer, highest volume.
Weather station — irradiance, POA, module and ambient temperature, wind. Without it nothing normalises.
Export and import meters — the commercial record, reconciled exactly, never estimated.
Events — alarms, trips, curtailment, maintenance windows. These explain the anomalies.
PV STRINGS — 42,000 modulesString invertersMPPT, 1,240 unitsWeather stationGHI · POA · tempSCADA gatewayModbus → MQTTPerformance Ratiolive PR vs contractualSoiling / shading lossper-string attributionGeneration forecastD+1 for schedulingToday · 18.4 MWhDGR automatedPPA compliance pack
From PV string through inverter and SCADA to performance ratio, loss attribution and day-ahead forecast.
02

Resolution: the decision that constrains everything

Whatever resolution you store determines the analysis you will ever be able to do. Fifteen-minute data is adequate for reporting and monthly performance ratio. Five-minute is the practical minimum for meaningful loss attribution, because inverter clipping and derating behaviour smooth out at coarser intervals. One-minute is preferable for forecasting model training and for diagnosing intermittent faults.

Storage cost is rarely the constraint that people assume. A 50 MW plant with 1,200 inverters at one-minute resolution generates a substantial but entirely manageable volume in a columnar format with compression — the annual storage bill is trivial relative to a single day of lost generation.

What is a genuine constraint is what the SCADA historian retains and at what resolution it downsamples. Many systems keep high resolution for thirty days and then aggregate. If you intend to do serious analysis, extract at native resolution into your own store before the downsampling happens, because that history cannot be recovered later.

The retention trap

We have been called into several plants wanting two years of string-level analysis, only to find the historian downsampled to hourly after ninety days. Set up extraction to your own store on day one — the cost is negligible and the alternative is irreversible.

03

Normalising performance so comparison means something

Raw generation tells you almost nothing, because it varies with irradiance, temperature and time of year. Performance ratio normalises for irradiance; a temperature-corrected performance ratio also normalises for module temperature, which matters enormously in Indian summers where cell temperature routinely exceeds forty-five degrees.

Computed at string level rather than plant level, and compared across the plant, this becomes a map of where losses are concentrated. Present it as a ranked list rather than a chart: the fifty worst-performing strings this week, with an estimate of the generation each is losing and a probable cause category. That turns an analytical exercise into a work order, which is the entire point.

Because normalisation removes weather variation, a genuine degradation trend becomes visible early rather than being lost in the noise of a monsoon month — which is what allows a warranty claim to be made while the warranty is still live.

04

Separating soiling from shading from degradation

These three look similar in aggregate output and demand completely different responses. Soiling is recoverable by cleaning and follows a pattern driven by dust, pollen and rainfall. Shading is structural and time-of-day dependent. Degradation is permanent and should follow a slow, predictable curve.

Each leaves a distinct signature. Soiling produces a gradual decline across a whole area that recovers sharply after rain or cleaning. Shading produces a repeatable time-of-day pattern correlated with sun position and season. Degradation shows as a persistent offset that does not recover after cleaning.

The practical output is a cleaning decision supported by numbers rather than a calendar: the soiling loss on a given block has reached the point where cleaning cost is justified. Most plants clean on a fixed schedule. Plants that clean on measured soiling loss recover meaningfully more generation for the same expenditure — on one 120 MW portfolio, reallocating the same cleaning budget between blocks produced around two per cent additional generation.

05

Automating the DGR and PPA compliance pack

Every asset produces a daily generation report and at most sites somebody assembles it by hand from a SCADA export, a meter reading and the weather station. It takes an hour or two, it is inconsistent between sites, and it is late.

Automating it is the fastest return in the whole programme, because the labour saving starts in week one and it establishes the data flow that everything else depends on. Data read from plant systems, computed against your definitions, and published in your exact format to a shared location or emailed before the reporting deadline. For portfolios, every site producing an identically structured report is what finally makes fleet consolidation something other than a manual reworking exercise.

PPA compliance follows the same pattern, with one caution: contractual availability is rarely the same as raw uptime. Exclusions for grid unavailability, force majeure and scheduled maintenance must be implemented exactly as the contract defines them, and the evidence trail must survive an offtaker challenging the number.

06

Forecasting, and measuring whether it works

Day-ahead forecasting matters for scheduling and, in markets with deviation settlement, for avoiding penalties. Build it from numerical weather prediction inputs combined with the plant's own historical response, because two plants under identical forecast irradiance generate differently depending on configuration, soiling state and inverter behaviour.

Always present forecasts with an interval rather than a single number, and track accuracy continuously. A forecast whose historical error nobody measures is a guess with a chart attached. After a few months of learning, day-ahead accuracy within four per cent on a monthly aggregate basis is achievable and is materially better than the generic forecasts many operators rely on.

DEMAND FORECAST — next 12 periodstodayactuals (MAPE 4.1%)forecast + 80% interval
A forecast with an honest confidence interval and tracked accuracy — the version you can actually schedule against.

Key takeaways

  • Four distinct streams — telemetry, weather, meters and events — with different roles and reliability requirements.
  • Store at native resolution from day one; historian downsampling destroys history you cannot recover.
  • Normalise for irradiance and temperature at string level, and present results as a ranked work list.
  • Soiling, shading and degradation have distinct signatures and demand different responses.
  • Automating the DGR pays back immediately and establishes the data flow everything else needs.

Frequently asked

No, and it is the normal case. Integration happens at the Modbus or SCADA level and the different register maps and naming conventions are normalised into a common model, so string-level analysis works identically across brands. Mapping takes a few days per manufacturer and only needs doing once.

Fifteen-minute for reporting and monthly PR. Five-minute or better for loss attribution and inverter behaviour analysis. One-minute is ideal for forecast model training. Start extracting at the highest resolution your SCADA exposes — you can always aggregate later, but you cannot recover resolution you never stored.

For a single site, often yes, and it removes any dependency on plant connectivity. For portfolios, cloud usually makes more sense because comparative analysis across sites is the point. Either way, plant-side collection should buffer locally so a connectivity drop delays rather than loses data.

Reporting automation saves labour from week one. Loss attribution typically produces its first actionable finding within six to eight weeks of baseline data, usually a set of underperforming strings or a soiling pattern that changes the cleaning schedule. Above roughly 20 MW the generation recovery alone generally covers the engagement within a year.

Next step

Tell us what is slowing your business down.

A 30-minute call with a senior engineer — not a salesperson. You leave with an architecture sketch and an honest cost range, whether or not you hire us.

Direct line

+91 70033 91355

Mon–Sat · 9:30 AM – 7:30 PM IST · Sealdah, Kolkata

Reply within one working hour NDA signed before any brief Fixed-price option on every scope
Verify us independently

Don’t take our word for it — ask an AI

Every page on this site is written to be read and quoted by AI answer engines, and we publish llms.txt and llms-full.txt so they can read us properly. One click opens the assistant with the question already typed.

The question we will ask for you

Summarise this article from Sayak Web Designer (sayakwebdesigner.in), an IT company in Kolkata, India: https://sayakwebdesigner.in/blog/data-aggregation-solar-industry-guide

Opens in a new tab. We do not see your conversation.

Call now WhatsApp Get quote