NISAR Composite Release ID (CRID)

• L0B updates
  • Implement L0B modification provided by ADT to address qSFP sample slip
    • Update to accept coarse global dem, antenna pattern file, and INT_CAL files as inputs for new algorithm to address QSFP
    • Update L0B runconfig schema
  • Corrected L0B valid data mask
  • Correct dtype selection for split fields in lowRateTelemetry
  • Address certain L0B list index out of range Error
  • Address certain L0B stuck jobs and times out error (ISA 222507)
  • Address L0B ingestion failure due to metadata issue (Discarded Rangelines)
  • Correct dtype selection for split fields in lowRateTelemetry
  • DM2 updates per ADT requirements
  • Update compute_look_direction for ISCE3 update to get_total_grid
  • Fix low rate telemetry to use highest bit when fields are signed ints and not in bytes
  • Update compute_look_direction for ISCE3 update to get_total_grid
  • Update docker files and version for ISCE3 r05.01.2-v0.25.8
• L1 and L2 updates:
  • Update docker files and version for ISCE3 r05.01.2-v0.25.8-1
    • ISCE3 r05.01.2-v0.25.8-1 is not an official git repo release.
    • This release pulled forward a single hotfix from eXperimental ISCE3 v0.25.10 to create a special operations version called ISCE3 r05.01.2-v0.25.8-1 to address a subtle frequency ID bookkeeping issue preventing RSLC generations for quasi-dual modes or mixed mode cases involving 77 MHz
  • L1_L2 runconfig schema updates in support of QSFP fix.
  • Fix phase offset caused by qFSP-H1 sample slip. Add a new module to compute residual RX channel imbalances, detect anomalies in received echoes (e.g., qFSP_H1 sample slip) where they are used as part of EAP in RSLC processing. Update antenna pattern module to use frequency band and caltone for proper synthesis of RX DBF pattern. This requires caltone frequency parser incorporated in Raw L0B parser.
  • Improve Raw parser with helper functions to parse chirp correlator and cal type properly by adding a support for cross-pol products as well as full polarimetric products for Quad-pol case that was wrong or missing. This fixes NEB in Quad-pol data
  • Update noise estimator module (NET) to handle QP properly with correct chirp correlator and cal type values. Also fix some potential biases in noise estimation due to dynamic CPI size in default MEE approach.
  • Update python API for noise estimator module used in RSLC to estimate NEB. The update adds support for QP w/ correct chirp correlator and cal type telemetry info and force CPI to stay as close as to the input value (or its maximum) for more robust noise power estimation across swath.
  • Update schema in InSAR workflow to allow for larger search window for ampcor module
  • Fix a bug in InSAR workflow in the estimation of ionospheric phase uncertainty
  • Fix a bug in GCOV/GSLC writer to ensure same data type for _FillValue to be the same as the dataset's data type
  • Fix bug in InSAR. Change the upsampling method from NN to bilinear in the rubbersheeting when interpolating the dense offsets to the size of input RSLC
  • Fix bug in amplitude cross correction module to allow for deramping with complex data. Fixing a pixel index error, using double precision for phase correction when deramping with complex data
  • Fix python crash on out of bounds array in LUT2D eval method. Check for out of bounds elements over input sequence before running. 
  • Fix bug in the shorter coverage of LUT datasets compared to the actual data. Add an extra margin to the RSLC LUT extents
  • Support new corner reflector CSV format and fixing a bug in computation of trihedral RCS
• Ancillary data updates
  • INT_CAL and EXT_CAL updates
• Parameter Set files:
  • Turn on EAP which is required for qFSP-H1 fix
  • Update the search radius for offset estimation. Now using double of search radius compared with the previous version. 
  • Adjust filter size for ionospheric phase filtering window size to avoid streaks in range direction 
• PCM updates
  • Update to pass coarse global dem, antenna pattern file, and INT_CAL files as inputs files to L0B for their new algorithm to address QSFP
  • Update hysds core v6.1.1 to address hysds_ui bug that can prevent ondemand jobs ui working properly needed to process historical data 
  • New feature to allow operator to issue state config re-eval with different inputs like fidelity of FRP or NRP to allow reprocessing with lower fidelity for a given granule when NRP/PRP fails without having to reconfigure the entire system globally
  • Automated cleanup of NEN valid duplicate deliveries from ISL via S3 tagging and lifecycle rules
  • Fixed OpenSearch Dashboard shard monitoring not being populated due to Data in Transit authentication
  • Fixed closed-index protection for PIT queries in query.py; eliminated raw ES calls

• L0B: Update to L0B to handle some edge cases. There was a change made in R05.00.7 for how L0B handles the range line index that caused some of these jobs to fail when there is a bad rangeline in the beginning of the observations. L0B was updated to throw out that single bad rangeline​
• PSF change: Fixed error in solid earth INSAR PSF files with duplicate phase_unwrap elements

• L0B: Address Antartica granule hanging due to a conflict with SELinux by ​backing out HDF5 cloud optimization introduced in R05.00.8 
• PSF: Enable deletion of intermediary files for INSAR to avoid hanging in c5.4xlarge instance encountered in smoke-test of certain granules

• L0B: HDF5 cloud optimization added to L0B
• L0B: Resolve PDS quaternion messages not decoded correctly
• L0B: Resolve Exception cannot reindex on an axis with duplicate labels
• L0B: Fix incorrect CRL_LEN and RL_START in the highRateTelemetry datasets
• L0B: Correct scene_center_spacing when center frequency is 0
• L0B: Support scientific notation for L0B PSF
• L0B: Incorporate call to sub-pixel shifting script
• L0B: Update valid sample mask to end at RL_STOP - RL_START + pad
• RSLC: Minor improvement to RSLC writer to use the description of some datasets to match the baseline spec
• INSAR: Minor improvement to InSAR writer to use the description of some datasets to match the baseline spec
• INSAR: Fix a bug in GUNW product where the geogrid for wrapped phase is wrong. This impacts 77 MHz data.
• INSAR: Add bridge algorithm to unwrap to improve phase unwrapping of Const PRF data
• INSAR: Add subswath mask for ionosphere phase filtering
• General: Fix API changes to Get/SetGeoTransform methods in GDAL 3.12
• PSF: Enable the rubbersheeting over the Cryosphere region
• PSF: Update STATIC link
• PSF: Re-enable QA exceptions when Rubbersheeting is used
• PSF: Update InSAR parameter for subswath mask and bridge algorithm
• PSF: Update the number of looks for the crossmul and unwrap

• L0B: Sub-pixel shift correction

• L0B: Move left gap trimming after listing negative first Tx gap 
• L0B: Update padding algorithm to match latest from ADT with np.floor
• L0B: Correct scence_center_spacing when center freq is 0 (partial fix)
• L0B: Swap WAVEGEN low rate TLM to be consistent with high rate TLM that is swapped with QP 
• RSLC: Update RSLC schema parameter from block_size to wavelet_size
• RSLC: Address decimating offset issue with frequencyB interferogram by reading slant ranges directly from the RSLC instead of RUNW to ensure proper alignment and accurate ionospheric estimation.
• RSLC: science.LSAR.RSLC.metadata.processingInformation.inputs.l0bGranules changed to reflect the granule id of the L0B that was focused instead of the input file path used in the SDS processing system
• INSAR: Output polarization of freq A and B into .met json for PCM to correctly determine cross polarizations
• INSAR: Fix a bug in splitSpectrum for Quad-pol data when splitting main band (if needed)
• INSAR: Add Polyfitting to compute the range and azimuth offsets for the fine resampling instead of rubbersheeting
• Parameter Set Files (PSF) config: Updated config files for freq A/B for ionosphere estimate, offset parameters, and INSAR deramping methods
• QA in General: Make each subgroup independently optional in QA schemas

• Updated TFdb (TrackFrame Database)
• Update L0A_TE to exit gracefully if all L0A data is corrupt
• Update RSLC to address large number of RSLC failures
• Update RSLC NESZ explicit receive only Angeline index
• Update GSLC to accept corner reflector
• Update GCOV for bug fixes and improve GCOV products in Quad-pol modes
• Update INSAR to add radar coordinates into products and improve ionosphere estimation
• Update INSAR metadata
• Update SME2 for bug fix of VWC input order, antimeradian crossing, private variable bug
• Update SME2 to compute Local Incidence angle on the fly at coarser posting than input GCOV product
• Update SME2 with TSR algorithm update with solver function for better solution space control, SMAP climatology data disaggregation using soil texture information, changed the condition for masking, and etc. to improve the output image quality
• Update SME2 with DSG algorithm update with a static ancillary file input to read in the algorithm parameter (Beta) values instead of using a look up table. Note: The Beta values in the LUT is not optimal and will need to be updated in the future
• Update SME2 to use the full name of the processing Type metadata in the product
• NISAR L1/L2 QA fixes

• Update L0B PGE code to remove .h5 from granuleId under identification group
• Update L0B to correctly set listOfRxPolarizations for partial Quasi QuadCorrect look direction case-sensitivity and platformName value
  Update L0B look direction algorithm to set the epoch for both the orbit and attitude
• Update L0B to not use SP because Header-only values are not correct for SP
• Update L0B to for DM1/DM2 to remove RL_START dependency for slant_range and padding, also handle change in DM2 number of samples
• Update L0B to address Frequency B alignment issues
• Added padding parameters for the gap positions in L0B runconfig
• Add filter delay and receive_only parameters as optional parameters in L0B runconfig
• Update L0B productSpecificationVersion to match PIX XML version
• Update L0B to create multipolygon in met for non self intersecting polygons over international data line (IDL) to allow DAAC to interpret granule location correctly over IDL

• Hi-Res Range-Doppler Single-Look Complex (RSLC) update for phase jumps
• L0B update for phase jump and 4th gaps
• DC_RADAR updates to support variable taps in DBF along the range line and to update antenna parser to allow finer Elevation/Azimuth (EL/AZ) angular spacing when their cuts over all channels are requested

Launch release