perf/direct zarr io

[d-v-b]

• eagerly compute multiscales
• directly copy chunk bytes and metadata documents

[codecov-commenter]

⚠️ Please install the to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

❌ Patch coverage is 92.85714% with 19 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
src/eopf_geozarr/s2_optimization/s2_multiscale.py	88.88%	7 Missing ⚠️
src/eopf_geozarr/zarrio.py	93.54%	6 Missing ⚠️
src/eopf_geozarr/cli.py	0.00%	4 Missing ⚠️
src/eopf_geozarr/s2_optimization/s2_converter.py	97.64%	2 Missing ⚠️

📢 Thoughts on this report? Let us know!

[d-v-b]

this argument solves #81. You would pass --omit-nodes "quality/l2a_quicklook" to omit that group

cc @emmanuelmathot

[d-v-b]

@emmanuelmathot the redundant multiscales calculation is now fixed, and the chunk sizes / sharding are now consistent with the design goal (use as few objects as possible).

On my local system, using dask for rechunking was much slower than what I am currently doing (plain assignment via zarr python).

[d-v-b]

since we are re-encoding the zarr groups here, I can also handle the NaN conversion in this branch, unless that's better in a separate branch @emmanuelmathot

[d-v-b]

with a1375b7 we have an option (defaulting to false) of allowing invalid values (nan and inf) in the output. When set to false (the default), any NaN or inf or -inf values in attributes field are replaced with string equivalents.

[emmanuelmathot]

Just tested the last version of this PR: https://api.explorer.eopf.copernicus.eu/raster/collections/sentinel-2-l2a-staging/items/S2B_MSIL2A_20251115T091139_N0511_R050_T35SLU_20251115T111807/viewer
but multiscales are still missing at /measurements/reflectance group

[d-v-b]

i'll have a look later today!

[emmanuelmathot]

@d-v-b it seems multiscales are working now but can you tell me wwhat is the fill value? It seems it has been changes (black part that should be transparent)

[emmanuelmathot]

seems also that we are missing the fixedscaleoffset codec declaration. I dont understand how xarray resolves correctly the data values.
Example:
zarr.json