AQUA 2024FEB release notes  

 

QA2: 

• BUG: ICT-23439: Band 1 MOUSes to go to Slow Lane
• BUG: ICT-23418: Allow forcing of Slow Lane when re-processing from Continue and Finish pop-ups (as well as the Do QA2 pop-up)
• BUG: ICT-23405: Make sure Fast/Slow lane decision is taken based on current (rather than a previous) Processing recipe
• BUG: ICT-23230: do not display Fast/Slow lane info for MOUSes where it is not yet available
• BUG: ICT-23380: Fix labels in Fast/Slow lane thresholds pop-up
• BUG: ICT-23386: QA2 primary key violation at “Start Weblog Review”
• BUG: ICT-23345: remove renorm text in automatic QA2 comment
• BUG: ICT-23281: fix zK session timeout re-direct

 

PROMO:

• BUG: ICT-23507: re-processing in PROMO is breaking fast/slow lane sorting – re-processing in PROMO is now not possible while the MOUS is in ReadyForReview
• BUG: ICT-23364: wrongly expanded weblogs cannot be re-processed by PROMO – there is now a button to remove and re-expand the weblog
• BUG: ICT-23268: manual weblogs cannot be loaded due to file size – fits files are now just listed, rather than hyperlinked
• BUG: ICT-21787: .source files to be cleaned from staging area automatically

 

DRA:

• BUG: ICT-23264: Chilean holidays not indicated properly in the Availabily tab – this could not be validated, so it is not clear whether this has been properly fixed, please keep a look out
• BUG: ICT-23130: Booking of dates in the past should not be allowed
• BUG: ICT-23129: Saved filters are not showing entries in project types

 

 

AQUA 2023NOV/DEC release notes  

 

QA0 (new QA0 GUI):  

• ICT-21267: set up correct Trx and Tsys for Band 1
• ICT-22990: automatically set the QA0 status for PSO gridsurvey EBs
• ICT-22937: code for the old QA0 interface to be removed, links from PT and AQUA-QA2 now point to the new qa0 interface
• BUG: ICT-22865: e-mail alerts for when an EB exceeds the 14-day time limit on PendingFluxcal not working

 

QA2: 

• ICT-22992: AQUA to start using the special modes defined by the OT. The Advanced search by special modes should now work correctly for all special modes from Cycle 10 and be much faster than previously
• ICT-22527: allow PL flags to be added when the Next Step is DRM Review
• ICT-22682: fix behaviour of QA2 and processing comments
• ICT-22526: allow the forcing of Slow Lane when reprocessing from ‘Do QA2’ pop-up
• ICT-22802: set DRM/DR automatically for fast lane deliveries according to Preferred ARC
• BUG: ICT-23086: cannot assign DRM
• BUG: ICT-23277: AQUA-QA2 not sending ADAPT heartbeat
• BUG: ICT-22454: Shiftlog tickets not displayed in AQUA-QA2

 

DRA:

• ICT-22587: show national holidays in the DRA availability search
• BUG: ICT-23302: Public holidays from next year not displayed

 

AQUA 2023OCT release notes

QA0 (new QA0 GUI):

• BUG: ICT-22944: Solar observations with “none” correlator have display issues
• ICT-22679: QA0 bulk tool to search and allow bulk setting of QA0 states in new interface
• ICT-22863: add TPS correlator as an option in the search interface
• ICT-22560: Spring/Hibernate 6 upgrade

QA2:

• ICT-22803: improve fast/slow lane sorting: QA3, TP, 7M MOUSes and slow lane reasons
• ICT-22812: improve image sensitivity table and automated QA2 comment for SELFCAL case
• BUG: ICT-22747: pipeline flags cannot be added from flag builder after “Continue Workflow” for ProcessingProblem MOUSes
• ICT-22561: Spring/Hibernate 6 upgrade

DRA:

• ICT-22566: Spring/Hibernate 6 upgrade
• ICT-22588: “Send us your comments” E-mail address updated

 

PROMO:

• BUG: ICT-22689: allow PROMO to process and store products for EEXX project codes

 

AQUA 2023JUL/AUG release notes

QA0 (new QA0 GUI):

• ICT-22402: warn AoD when Trx differs by more than 50% between polarisations
• ICT-22309: Bulk QA0 status change tool for new AQUA-QA0
• ICT-22273: make AQUA QA0 search results list exportable
• ICT-22130: display time dependence of Tsys and Trx in QA0 atmosphere plots
• ICT-22393: load new ACASPEC EBs into AQUA-QA0
• ICT-19929: use median of channels around representative frequency for Tsys plots (avoiding edge channels)
• BUG: ICT-22510: fix typo in EB link in notification e-mails
• BUG: ICT-22471: no data available in Phase tab for FluxCheck EBs
• BUG: ICT-22517: warning for time critical EBs missing
• BUG: ICT-22578: fix search by SB UID and SB name
• BUG: ICT-22403: fix QA0 pdf report generation
• BUG: ICT-22392: for 7M SBs show uncorrected baseline-based phase plots by default
• BUG: ICT-22532: fix NPE after “scan’s source name is null, cannot get flux measurement without one”
• BUG: ICT-22677: new QA0 needs to store information for EBs without OBSERVE_TARGET intent
• BUG: ICT-22431: fix warning about MOUS going to FullyObserved

QA2:

• ICT-21971: scale sensitivity for SingleDish MOUSes to align with Cycle10 pipeline. During testing we had some issues with the sensitivity value in the ‘Finish’ pop-up not being auto-filled and could not satisfactorily test this in the SCCB-1308 patch – please keep a look out for this!
• ICT-22528: add warning in “Do QA2” pop-up if SB is in ObservingTimedOut
• ICT-22452: mark and allow searching of Joint Proposal MOUSes Note that this was never validated due to lack of Cycle 10 data. Please test this in production!
• ICT-22598: MOUSes with the following AQUA-QA2 warnings should go go slow lane: elongated beam, outside time constraints, rms too high, beam too large/small
• ICT-22576: read image name for automated QA2 comment from Cycle10 pipeline_aqua_report
• ICT-22410: adapt name of hifa_spwphaseup metric to Cycle10 pipeline nomenclature
• ICT-22451: Elevated impact: make flag visible and searchable
• ICT-22457: enable automatic QA2 and delivery for fast lane MOUSes note: this is not yet turned on but could be turned on at any time
• ICT-21838: automate handling of renorm in the QA2 comment
• ICT-22456: add tooltip to EB overview table heading
• BUG: ICT-22450: align EC needed for an SB to go back to the queue for observing with the scheduler’s logic
• BUG: ICT-22791: AQUA should read only representative sensitivities from Cycle10 pipeline and the reference sensitivity should be the selfcal one if available. Note that for the long-baseline cases, selfcal products are often available for cont and mfs but not cube. In this case, AQUA does not know what to do and the DR/DRM may have to fill the correct values (available from the image parameters table) by hand in the ‘Finish” pop-up. Note also that the “Selfcal applied” tick box in the QA2 comment generator will *not* be ticked by default – you will have to manually tick this in the case that selfcal products are available!
• BUG: ICT-22615: SingleDish QA2 comment: fix image parameters behaviour
• BUG: ICT-22102: processing comments should be labelled as such
• BUG: ICT-22278: QA2 reasons are not being deleted for QA2 PASS MOUSEs
• BUG: ICT-22497: fix manual editor tab to introduce pipeline flags
• BUG: ICT-22489: fix “continue workflow” functionality after ProcessingProblem

QA0 and QA2:

• BUG: ICT-22775: AQUA properties are not being displayed

PROMO:

• BUG: ICT-22689: allow PROMO to process and store products for EEXX project codes

 

 

AQUA 2023MAY/JUN release notes

QA0 (new QA0 GUI):

• ICT-22126: allow all types of tickets to be added
• ICT-22127: allow attachment of files
• ICT-22128: rearranging of EB summary page
• ICT-22269: recommend QA0 semi-pass if EF < 0.2
• ICT-22129: add tooltips for QA0 pending reason interface
• ICT-21617: updated PendingFlux logic for high frequency
• ICT-22355: show AQUA QA0+ phase/checksource separation
• BUG: ICT-21952: fix link to PRTSPR tickets in ShiftLog comments
• BUG: ICT-21982: homogeneous X and Y unit length in plots
• BUG: ICT-22225: no phase rms plots if EB has only one BB
• BUG: ICT-21625: source coverage not correctly computed for fill pattern cases
• BUG: ICT-22368: fix new QA0 GUI permissions (QAA / AOD / ARCA / DRM now all have access)
• BUG: ICT-22125: Tsys and Trx are swapped in atmosphere summary table
• BUG: ICT-22383: wrong phase calibrator separation in Calibrators tab

QA2:

• ICT-22230: change ‘APA’ to ‘PROMO’ in AQUA mentions and links
• ICT-22005: auto-refresh when adding tickets note that if multiple tickets are added, they are not necessarily all visible and the MOUS should be refreshed
• ICT-21972: new requirements for QA2 phase calibrator fluxes to be ingested into Source Catalogue: good phase rms, S/N > 30, bandwidth > 400 MHz
• ICT-22274: fixes to fast/slow lane functionality 
• ICT-22070: improvements to the automatic proprietary time implementation
• ICT-21890: provide access to the broken weblog for unsuccessful pipeline runs
• ICT-21922: generate semi-automatic QA2 comment also for SingleDish MOUSes
• BUG: ICT-22000: add warning pop-up when modifying the proprietary time

PROMO:

• ICT-21957: PROMO url changed to asa.alma.cl/promo (was /apa before)
• ICT-21889: support broken weblogs

DRA Tool:

• ICT-22352: show only available Data Reducers in search results

 

General:

• BUG: ICT-22428: IRS: Null ‘x’ argument

 

AQUA 2023MAR/APR release notes

QA0:

• BUG: ICT-21370: correct the pressure values in the AQUA-QA0 weather report
• ICT-17449: move the spw info and display in graphical form in new QA0 interface
• ICT-21806: option to order search results list by antenna name or number of issues
• BUG: ICT-21794: fix phasecal separation from target value in QA0 report
• BUG: ICT-21981: start date in search fixed in new AQUA
• ICT-21803: display EB status and duration in new AQUA
• ICT-21769: new QA0 flag: Pending_pipeline
• ICT-21884: provide a user-friendly way to disable tabs with non-available data
• BUG: ICT-21894: do not allow duplication of QA0 FAIL/SEMI-pass reasons
• ICT-21072: display average Tsys and Trx of individual basebands
• BUG: ICT-21751: solar system objects should not go to Pending_fluxcal status
• ICT-22106: update tooltip in QA0_flux fail/semi-pass reason
• BUG: ICT-21310: “Waiting for flux service” warning should disappear after QA0 PASS
• ICT-21805: option to reset antenna/band selection only in the advanced search

QA2:

• ICT-22084: fix error for negative pipeline score values
• BUG: ICT-22237: issue of removing a detached instance
• ICT-21713: new supplemental imaging reason: manual robust value
• ICT-21562: automated QA2 comment: extend pre-filled information and make it accessible from ‘Do QA2’ button
• ICT-21973: fast slow lane thresholds for pipeline scores: create database for easy modification
• ICT-22068: improve QA3 bulk tool text
• ICT-21561: improvements to the task score overview table
• BUG: ICT-21917: ZK session still active after keycloak session timeout
• ICT-21986: upgrade ZK to 9.6.3

PROMO:

• ICT-21974: upgrade to java17
• ICT-22108: fix deployment exception post jdk upgrade

Batch-helper:

• ICT-21494: identify external ephemeris TP MOUSEs as pipelineable

 

General:

• ICT-21546: RestHighLevelClient has been deprecated

 

AQUA 2023FEB release notes (including former 2022OCT/2022NOV/DEC)

 

QA0:

• ICT-20368: Execution fraction to take into account cases where last CALIBRATE_PHASE scan is corrupted
• ICT-21604: Skip Pending_Fluxcal logic for Solar EBs
• ICT-21073: inform users about conflicting QA0 status setting attempts
• ICT-21143: minor improvements and bug fixes to the new QA0 GUI
• ICT-21622: mosaic coverage plots should exclude OBSERVE_TARGET OFF_SOURCE fields
• BUG: ICT-21296: remove flux service warning for TP EBs
• BUG: ICT-21264: AQUA does not search by QA0 semi-pass/fail reasons
• ICT-21262: for calibrator surveys, AoD should be required to set the QA0 state manually
• BUG: ICT-21034: fix issue with QA1 sub-string search
• BUG: ICT-20970: fix NullPointerException at Phase tab
• ICT-21140 (aqua-batch-helper): failure to ingest QA1 data because of duplicated project code
• ICT-20801: AQUA-QA0 should share its tickets with WebSLT
• ICT-21172: show scan elevations in EB summary text and plots
• BUG: ICT-21164: fix time on source being 0 for calibrator sources
• ICT-19941: log essential user operations in the new QA0 GUI

QA2:

• ICT-21546, ICT-21674: software updates
• ICT-21342: capture additional information for the QA3 workflow (including QA3anchordate from the PRTSPR ticket)
• ICT-21341: improvements to the QA3 bulk tool
• ICT-21252: fix format display of QA3 reasons
• ICT-20837: automate new proprietary time after QA3 
• ICT-21560: improvements to the fast/slow lane implementation, including revised scores
• ICT-20085: add Contact Scientist info in the data reducer assignment e-mail
• ICT-20799: show any JIRA tickets opened for QA0 at QA2
• BUG: ICT-20981: incorporate new special modes (bwsw, b2b, astrometry) into Advanced Search
• BUG: ICT-21006: show session time-out message
• ICT-21183: semi-automatic QA2 comment : add remcloud templates
• ICT-21238: add project code and SB name into the description of AQUA-generated PRTSPR tickets
• ICT-21240: improvements to fast/slow lane functionality
• ICT-21250: show “Comment to AoD” in AQUA
• BUG: ICT-21253: remove fake observed pointing for mosaics
• ICT-21254: improve user experience for adding tickets
• ICT-21291: display status of Raw Data Request in AQUA
• BUG: ICT-21091: fix downloading/uploading files with Safari browser
• ICT-21417: unify JIRA URL configuration
• ICT-19351: Refactor OUSQA2 composer
• ICT-21368: allow user to trigger re-ingestion for the new DeliveryInProgress+PreparationError substate and make the new substates searchable in the Advanced search

PROMO

• ICT-21650: fix unmanageably long NGAS logs
• ICT-20559: make sure that problems with the QA0/QA2 report creation will result in an ingestion error

 

DRA Tool

• BUG: ICT-21431: multiple entries shown for each DR

 

AQUA 2022JUL/AUG release notes

 

QA0:

• BUG: ICT-20774: fix the way AQUA recognises array type of an SB
• ICT-20660: show breakdown of QA1 statistics based on QA0 issue frequency

 

QA2:

• ICT-20669 (aqua_batch_helper): update pipelineable modes for Cycle 9 (in particular the new b2b and bwsw need to be recognised as non-pipelineable)
• ICT-20668: update list of special modes (including astrometry, b2b and bwsw)
• ICT-20914: allow new-format Cycle 9 aqua_pipeline_reports to be processed
• ICT-20797: incorporate the fast/slow lane sorting algorithm into AQUA
• ICT-20795: add parameters from additional pipeline images to the Image Sensitivity table
• ICT-20825: AQUA support for the new raw_data_release flag (display flag, allow for search by flag, send notification e-mails)
• BUG: ICT-20974: bugs in QA2 comment template
• BUG: ICT-20798: limit number of possible QA3 reasons to 3

 

PROMO

• BUG: ICT-20956: update building library

 

DRA Tool

• BUG: ICT-20796: fix export facility in the Management tab
• BUG: ICT-20922: fix data in Last QA0 Pass EB column
• BUG: ICT-19605: Management tab query can cause heap overflow
• ICT-20582: fix overlapping of page content with search field in the Management tab
• ICT-20569: recognise inactive data reducers

 

AQUA 2022MAY/JUN release notes

 

QA0:

• ICT-20062: angular update for AQUA-QA0 new AQUA-QA0 available at asa.alma.cl/qa0
• ICT-20040: enable use of 7m antenna array on BL Correlator
• BUG: ICT-20044: incorrect expected OFF position plotted
• BUG: ICT-20601: cannot format given object as number

 

QA2:

• ICT-20182: display PRT tickets created by PLDriver in AQUA
• ICT-20643: improvements/fixes to the semi-automation of the QA2 comment
• ICT-20571: advanced search by ticket number
• ICT-19806: automatic transition to QA0semipassonly workflow
• ICT-20429: QA0semipassonly workflow: add automatic QA2 comment
• ICT-20430: display QA3 reason on MOUS summary page
• BUG: ICT-20647: QA2 not responding
• BUG: ICT-20471: exception when deleting DRM Review comment
• BUG: ICT-20499: some ALMA_QA2 fluxes ingested to SC are incorrect

 

PROMO

• ICT-20788: allow download of all auxproducts files, including renorm

 

DRA Tool

• ICT-20435: display specifics of the workload per analyst
• ICT-20434: add sorting capability to the management tab
• ICT-20259: hide old booking entries from the list to prevent cluttering
• ICT-20424: add facility to export Management tab results
• ICT-20423: add facility to export Dashboard tab results
• ICT-20422: days without bookings should by default be Unset
• ICT-17965: angular update for DRA tool

 

AQUA 2022MAR/APR release notes

QA0:

• ICT-20223: add DATA and TPOFF to list of QA0 FAIL reasons
• ICT-19299: show EB observing date in the summary tab
• BUG: ICT-20087: fix Execution Fraction algorithm for cases where the execution time is not governed by sensitivity
• BUG: update plotted Trx values to be consistent with the OT

 

Affects QA0 and QA2:

• ICT-20033: migrate AQUA to Keycloak (login page has a slightly different look than before, but login should work as normal)

 

QA2:

• ICT-20059: semi-automation of the QA2 comment. Note: this tab in the ‘Finish’ pop-up only appears when Next Step = DRM Review has been selected!
• ICT-20018: effective channel width and spectral window ID added to the Image Sensitivity table
• ICT-20000: QA3: allow pipeline flags to be added if Next Step contains pipeline processing – you should now be able to immediately add flags for a QA3 case, without processing first
• ICT-19999: new QA3 reason: needs Renorm
• ICT-19614: add new non-obvious transition “Renorm fixes needed”
• ICT-13617: improvements to the AQUA-DRA interfact
• BUG: ICT-20245: fix flagging command generated for TP flagging by antenna
• BUG: ICT-20047: DRs and their availability not appearing correctly in AQUA
• BUG: ICT-20019: fix sorting MOUS list by state

 

PROMO

• ICT-19997: show links to all weblogs (not just the delivered ones) from the Weblog tab
• ICT-19444: display improvements for manual weblog
• ICT-19443: fix region statistics of staging area data
• BUG: ICT-19919: fix settings when calling ProductIngestor

 

DRA Tool

• ICT-20253: grant access to the Availability tab to ARC node managers
• ICT-20251: by default, Available time periods cover only weekdays
• ICT-20250: Column for PRTSPR tickets renamed to Related Tickets
• ICT-20246: allow overwriting of booking entries by a more recent entry
• ICT-19873: allow editing of existing booking entries
• BUG: ICT-20066: fix sorting functionality for QA2 Dashboard results
• BUG: ICT-19954: booking system creates wrong dates for some entries

 

 

AQUA 2022FEB release notes

BUG fixes only

 

QA0:

• ICT-19812: grey-out irrelevant tabs for EBs without ASDM data
• ICT-19823: show optional self-cal image from QA0+
• ICT-19876: correct phase rms unit in the source summary table
• ICT-19950: write weighted mean frequency to the ALMA_QA0 source catalogue for the bandpass calibrator
• ICT-19958: fix logic for Pending_Fluxcal QA0 status

 

QA2:

• ICT-19227: fix UiException “not unique in ID space”
• ICT-19576: enable download option for manual weblogs
• ICT-19586: fix ‘Remcloud advised’ logic in AQUA QA2
• ICT-19709: allow MOUS to be sent back to Data Reducer after being placed under DRM review
• ICT-19744: fix representative window for spectral scans
• ICT-19791: fix formatting of ‘Show Products’ box
• ICT-19862: enable search by text string in the Final QA2 comment box
• ICT-20149: fix incorrect flagging command generated by flag builder when flagging by scan

  

AQUA 2021NOV/DEC release notes

New features/improvements unless marked as BUG

 

QA0:

• ICT-18573: new AQUA QA0 this is for the development of the new QA0 interface; not yet in production for 2021DEC
• ICT-19641: new logic implemented for Pending_Fluxcal status
• ICT-18565: write weighted mean frequency of flux measurements to ALMA_QA0 source catalogue
• BUG: ICT-19266: QA0 state column has resizing issue when QA0StatusReason is too long
• BUG: ICT-19569: issue with automatic setting of remcloud flag based on QA0+ result
• BUG: ICT-19495: designation of special mode “Solar” must not be based on source name
• BUG: ICT-19493: correct cycle number for 2021.* projects
• ICT-19526: move QA0Robot functionality to AQUABatchHelper

 

Affects QA0 and QA2:

• BUG: ICT-19403: allow resizing of search panel

 

QA2:

• ICT-19423: additions to the possible ‘Reasons’ in the PL flag builder
• ICT-19272: QA3 bulk change tool: put warning messages in Log if the MOUSes are not in the correct state initially
• ICT-19495: PL flag builder: colour-code scans and fields by intent
• ICT-18602: improvements to the phasecal fluxes plot
• BUG: ICT-19635: PL flag builder: fix ‘antenna’ flagging command for TP observations
• BUG: ICT-19578: correct number of antennas in the EB table for the case that no aoscheck report is available

 

PROMO:

• ICT-19668: list the imaging products in the manual weblog
• BUG: ICT-19579: correct number of antennas from ICT-19578 also in PROMO

  

  

AQUA 2021OCT release notes

New features/improvements unless marked as BUG

 

QA0:

• ICT-19419: for ACA observations any PM antennas that are included for calibration purposes are excluded from the EF calculation
• ICT-19186: allow a wild-card option in the QA1 text search
• ICT-18683: add target – checksource separation to the QA0/QA0+ database

 

QA2:

• ICT-19203: warning “beam too elongated” happens when major axis > 1.5*minor axis for “normal” Dec soures, and at > 2.5 for low elevation sources
• BUG: ICT-19418: fix wrong warning for pipeline calibration ingestion
• BUG: ICT-19449: fix GUI control exceptions
• BUG: ICT-19302: make QA3 bulk transition tool set the QA3ongoing flag
• BUG: ICT-19249: fix exception when loading MOUS with bad timestamps

 

PROMO:

• ICT-18210: improve PROMO GUI homepage
• BUG: ICT-19634: stop removal of manual weblog script directory during staging area cleanup
• BUG: ICT-18965: improve weblog for manual imaging products

 

DRA:

• ICT-18800: migrate DRA tool from semantic to bootstrap – should not change any functionality
• BUG: ICT-19267: fix statistics of counting MOUSes worked on per analyst

  

  

 

AQUA 2021JUL/AUG release notes

New features/improvements unless marked as BUG

 

QA0:

• ICT-18571: alert user if QA0 status was already set by background process when attempting QA0
• ICT-18612: QA0 source catalogue: change name of amplitude calibrator to Jy/K conversion factor
• BUG: ICT-19138: fix memory leaks
• BUG: ICT-18956: default search time range fails – default now changed to last three months
• BUG: ICT-18930: allow computation of EF also for failed/incomplete EBs
• BUG: ICT-18629: use total (not per-tuning) on-source time for the EF calculation of spectral scans

 

Affects QA0 & QA2:

• ICT-18778: upgrade to ZK8.6, default theme is iceblue. Note: to revert to the previous default theme call AQUA as asa.alma.cl/webaqua/?theme=breeze (QA0) and asa.alma.cl/qa2/?theme=breeze
• ICT-18652: better error handling when trying to open a JIRA ticket with invalid credentials
• BUG: ICT-18957: comments are no longer lost if two users try and comment at the same time – when the page is reloaded both sets of comments appear
• BUG: ICT-18929: stack trace is now shown in addition to an informative error message

 

QA2:

• ICT-18396: QA0+ remcloud warnings / results are now visible in QA2 on the summary page as well as in the EB overview table
• BUG: ICT-19029: dead links to knowledgebase articles have been updated
• BUG: ICT-18894: now a warning is given if the Next Step selected for processing is incompatible with previously ingested products also in the ‘Do QA3’ pop-up
• BUG: ICT-18293: clean-up of the search layout

 

 

PROMO:

• ICT-18211: summarise products by region in GUI
• BUG: ICT-18655: stop incorrect processing of JAO home directory
• BUG: ICT-18810: fix logging configuration

 

 

AQUA 2021MAY/JUN release notes

New features/improvements unless marked as BUG

 

QA0:

• ICT-18366: allow editing of the QA0 flags only when it is also possible to set the QA0 state, otherwise deactivate the possibility for editing
• ICT-18250: separate GridCal and Other Calibration projects in the search functionality
• ICT-18656: include aoscheck warnings in the Final QA0 Comment
• ICT-18327: automatically set science-like EBs to QA0 FAIL if there is no bandpass, flux, phase or target intent in the data
• ICT-17604: QA0+ data included (with a warning message) in the QA0 report (ingested into the archive after QA2)
• ICT-18328: for non-science EBs, automatically set QA0 PASS/SEMI-PASS or FAIL (never Pending FluxCal) and the EF based on aoscheck results
• BUG: ICT-18427: give an explanation why the EF is set to 1 for time-critical EBs
• QA1: allow search through aoscheck/QA0 database for EB issues

 

QA2:

• ICT-18326: add a new QA3 reason called “software testing”
• ICT-18586: display previous end of proprietary time when finishing QA3 (at the point where the proprietary period can be changed)
• ICT-18515: two new non-obvious transition reasons added: “Pipeline crashed due to environment or offline software” and “Data set needs to be re-run with a different CASA version”
• ICT-18511: do not allow Cal&Img products ingestion when Cal-only products have already been ingested
• ICT-18448: give a warning if the processing selected as “Next Step” would result in products incompatible with those that have been previously ingested
• ICT-18344: show type of ingestion (reports only / all data products) in the “ingestion history” pop-up
• ICT-17329: have pop-up “Ingestion successfully triggered” also after cal-only ingestion
• ICT-10656: support option to turn on or off e-mail notifications (set in the User Registry) for your own changes
• ICT-17114: support .P projects: allow search, include mode, treat like .V projects
• BUG: ICT-18567: fix issue with image beam and rms values not being autofilled in the ‘Finish’ pop-up

 

QA0 / QA2:

• ICT-18155: html versions of QA0/QA2 reports are no longer created (only pdf stays available)

 

PROMO:

• ICT-18373: html versions of reports are no longer created
• ICT-17024: create manual weblogs similar in format to the pipeline weblogs
• ICT-17911: streamline the naming of manual weblogs and differentiate between cal, img or cal&img

 

DRA:

• ICT-18199: allow users to create custom-made filters for the QA2 Dashboard
• ICT-18719: improve visualization of statistics results in the management tab
• ICT-18512: update authentication mechanism to Keycloak
• BUG: ICT-18203: exclude 7-m cases from filtering by ’12-m array’ in the QA2 Dashboard
• BUG: ICT-18611: do not allow a DR to be stored without an associated ARC

 

AQUA 2021MAR/APR release notes

New features/improvements unless marked as BUG

 

QA0:

• ICT-17460: QA0 state to be automatically set based on aoscheck recommendation for go/no-go and fluxcheck EBs
• ICT-17743: EBs with no science target scans marked in the database (so the MOUS can be set to NotObserved by the state system and marked in SnooPI)
• ICT-17693: identify EBs without bandpass, flux, phasecal, science target and suggest QA0 semi-pass with corresponding reason (can still be overwritten manually)
• ICT-17803: support QA1 search for recurring issues with individual antennas
• ICT-18157: show flux plot with source catalogue fluxes at QA0
• BUG: ICT-18397: fix QA0 Robot so that transition from Suspended to FullyObserved is correctly performed

 

QA2:

• ICT-17942: display product ingestion history via pop-up button
• ICT-17941: modifying proprietary time from AQUA via the Abort QA3 button or when setting a new QA2 state. Some usability improvements made, in particular the previous proprietary time end date is now displayed.
• ICT-17914: the MOUS UID is now a column in the search results table
• ICT-17513: QA3InProgress bulk change transition tool: users can upload a list of MOUSes with a QA3 flag (ObservatoryInitiated / UserInitiated) and any associated tickets
• ICT-17822: saved Advanced searches now available from the QA2 landing page, basic searches can no longer be saved but are included in the Advanced search options
• ICT-17172: display parallactic angle per session
• ICT-18201: show flux plot for phase calibrator fluxes to be ingested pre-QA2
• ICT-18151: QA1 code removed from report generating in AQUA/IRS
• BUG: ICT-18048: Source Catalogue query to be made more robust

 

 

PROMO:

• ICT-18099: improve performance of “Pipeline run directories in error status” search by MOUS UID
• ICT-17989: files necessary for reprocessing can be directly downloaded from ProMo
• ICT-18232: ADAPT security update
• BUG: ICT-18007: QA0SemiPassOnly MOUSes are now removed from the staging area when delivered
• BUG: ICT-18370: Remove and Reprocess buttons have been restored

 

 

DRA:

• ICT-17456 : query by Contact Scientist supported in Management tab
• ICT-17457: basic statistics available for search results in Management tab: total number of processing work and pie charts
• ICT-16794: search results that need action are highlighted in the QA2 Dashboard
• BUG: ICT-17921: users that already left the project are included in search results in the Management tab

 

 

AQUA 2021FEB release notes (bug-fix only release)

QA0:

• BUG: ICT-18048: make source catalogue query used by AQUA more robust
• BUG: ICT-17896: correction to QA0+ results in AQUA

 

QA2:

• BUG: ICT-17831: failure to read data from pipeline report and load MOUS when bandwidth is given as N/A
• BUG: ICT-17802: longer lists of ingested products do not wrap correctly
• BUG: ICT-17627: ‘other’ added as non-obvious transition reason
• BUG: ICT-16888: processing tabs hidden for substates that did not make it to ‘Ready for Review’
• BUG: ICT-16770: allow pipeline flags to be added even when the EB is no longer stored at the OSF

 

PROMO:

• BUG: ICT-17973: fix phasecal flux ingestion for multi-EB manually processed MOUSes

 

DRA:

• BUG: ICT-17920: E2E projects should not be included in QA2 Dashboard search results
• BUG: ICT-17925: users with ARCA role should be able to access the Management/QA2 Dashboard tabs in the DRA tool
• BUG: ICT-17617: include all MOUS with ‘QA3 ongoing’ flag in search results
• BUG: fix DRATool logging

 

AQUA 2020NOV/DEC release notes

New features/improvements unless marked as BUG

 

QA0:

• ICT-17448: add links to the MOUS QA2 page (if available) from the EB in the QA0 GUI
• ICT-16651: include a time range option in the advanced search – this allows e.g. a search by name and date range simultaneously
• ICT-16329: Read QA0+ data from the database
• ICT-17402: AQUA to confirm correct catalogue name in configuration
• BUG: ICT-17660: index -1 out of bounds for length 0

 

QA2:

• ICT-17349: ingest phasecal fluxes from manual processing into SC – works only for single EB MOUSes so far
• ICT-17514: allow proprietary time to be modified when QA3 is aborted
• ICT-17258: predicted sensitivity is obsolete in the case of pipeline processing and is not displayed anymore
• ICT-16912: DeliveryInProgress+IngestionTriggered substate removed from AQUA
• BUG: ICT-17589: Status listed in processing tab should be the last status associated with that processing flag: the status will now show the actual final state (normally Verified) for a given processing flag
• BUG: ICT-17587: AQUA was not checking for previously ingested product types when attempting cal-only ingestion from the ‘Do QA2’ or ‘Ingest’ buttons
• BUG: ICT-17588: Informative pop-up was showing the wrong processing recipe in the informative state transition pop-up
• BUG: ICT-17350: frequencies shown in the PL flag builder have now been corrected to match those in the weblog

 

 

PROMO:

• ICT-17400: PROMO support for phasecal ingestion from manual processing into SC
• ICT-17572: support for deprecation of DeliveryInProgress+IngestionTriggered substate
• ICT-17405: improve the list of PROMO results opened from link in AQUA
• ICT-17401: improvement to disk usage stats on the PROMO landing page (grouping according to MOUS state)
• ICT-17184: store and show PROMO operations history in a pop-up
• BUG: ICT-17595: implement state transition to DiP+IngestError in case of Cal-only ingestion

 

DRA:

• ICT-16934: re-vamp columns for tracking and reporting data processing work
• ICT-17455 : query by time in Management tab – these two tickets allow the data processing work in a given cycle or timeframe to be displayed by data reducer, display the data reducers qualifications, etc

 

 

AQUA 2020OCT release notes

New features/improvements unless marked as BUG

 

QA0:

• ICT-17403: allow re-calculation of EF for EBs which have ‘Do QA0’ disabled
• ICT-17374: add more options to QA0 FAIL/SEMIPASS reason
• ICT-17136: Set EF to 1 for Solar interferometry projects

 

QA2:

• ICT-17257: change presentation of PipelinePolCal label in GUI
• ICT-17319: exclude non-processing lifecycle states from default searches
• ICT-17320: additions to the log console window
• BUG: ICT-17226: make entering a “non-obvious” transition reason mandatory

 

PROMO:

• BUG: ICT-17411: fix “Problem while reclaiming delivered pipeline run directories related to MOUS” error

 

 

AQUA 2020JUL/AUG release notes

 

QA0:

• ICT-16880: spectra tab should show the same spw numbering as listobs
• ICT-16953: pop-up message for QA0 PendingFluxCal to PendingOther change corrected to say “more than 15 days…”
• ICT-17091: computed on-source time rounded to the nearest 1 %
• ICT-17100: complete final QA0 comment now included in QA0 report
• ICT-17109: if QA0 state is changed to FAIL, the calibrator flux in the QA0 database is set to invalid
• BUG: ICT-17371: zul error in Calibrator tab fixed

 

QA2:

• (batch-helper) ICT-16833: identify polarization MOUSes and set the ObservingMode
• ICT-16834: support PipelinePolCal – to be fully validated during 2020 e2e tests!
• ICT-16869: supplemental manual imaging flag and reasons are now pre-filled in the ‘Do QA2’ pop-up from the info entered in the ‘Finish’ pop-up
• ICT-16894: AQUA supports the new cal-only ingestion tracing workflow
• ICT-16915: list of search results can now be exported to a text file and QA2/QA3 FAIL/SEMIPASS reasons, supplemental manual imaging and non-obvious transition reasons can be shown
• ICT-16917: for manual processing, image type and robust value can now be captured
• ICT-16936: in the PL flag builder, the channel and frequency ranges of the spws are shown to facilitate manual flagging
• ICT-17074: explanatory tooltip added to the ‘ingested’ icon
• BUG: ICT-17004: in the advanced search, QA2/QA3 Fail and non-obvious transition reasons can now be de-selected
• BUG: ICT-17068: search by ‘not assigned’ DRM/DR as well as search without any options now works
• BUG: ICT-17113: the phase rms values in the QA2 report are now correctly reported in degrees
• BUG: ICT-17203: error in transition from ProcessingProblem -> ReadyForProcessing fixed

 

Affects QA0 and QA2:

• ICT-16604: minor further improvements to JIRA ticket functionality
• ICT-16865: there is a new console window tab, where essential operations (state change, ingestion of products etc) are logged
• ICT-16868: configuration properties are displayed as a pop-up from “AQUA properties”
• ICT-16908: the time constrain warnings now refer to EB UID and SB name for QA0, to MOUS UID and SB name for QA2

 

PROMO:

• Performance enhancement:
  • ICT-16887, ICT-16890, ICT-16892, ICT-16893: automated clean-up
  • ICT-16889: speed optimization
  • ICT-16891: security
  • ICT-15196 : the data reduction type listed in the ‘pipeline runs’ table now corresponds to the recipe shown in AQUA
  • BUG: ICT-16801: the owner/region is now preserved during the transfer of a pipeline run
  • ICT-16895: support the new cal-only ingestion tracking
  • ICT-16962: weblog size shown in ‘Weblogs’ page
  • ICT-17054: improvement to the workflow when hitting the weblog size limit for display
  • BUG: ICT-16319: technical issues with PROMO in production fixed
  • BUG: ICT-17284: fix to error with weblog ingestion
   

 

AQUA 2020MAY/JUN release notes

 

QA0:

• ICT-16647: Execution Fraction ceiling is set to 0.2 if the representative source was not observed
• ICT-16617: the QA0 report has been updated and reorganised
• ICT-16580: QA0 FAIL reason keywords are explained by a tooltip
• ICT-16521: the Amplitude tab now has a new plot: amplitude vs scan number and baseline
• ICT-16460: manual state transitions from Pass, Unset or Pending automatically check for flux calibrator within the 15-day timeout period
• ICT-16405: QA0 fluxes for bandpass, flux and phase calibrators are written to a test database for any state but FAIL

 

QA2:

• ICT-16942: weblogs larger than 9GB cannot be opened directly anymore but must be downloaded
• ICT-16940: there is now a pop-up warning if no frequency unit has been entered for flags in the flag builder
• ICT-16797: data processing methods (and the associated tabs) that led to product ingestion are now highlighted in the AQUA GUI
• ICT-16796: the data reducer history is now captured in a pop-up box on the OUS summary tab
• ICT-16795: some fixes were made to the Advanced Search options, new QA2/3 FAIL/SEMI-PASS reasons were added
• ICT-16648: if the non-obvious transition reason was ‘state changed by mistake’, no QA2 parameters are required to move to the next state
• ICT-16638: for manual processing, the image type can now be selected from a drop-down list
• ICT-16636: spectral window flagging can now be specified in frequency units
• BUG: ICT-16749: ‘index out of bounds’ error fixed

 

Affects QA0 and QA2:

• ICT-16637: warning before setting QA0/QA2 state for time-dependent EB/SBs

 

PROMO:

• BUG: ICT-16929: Delivery is not being triggered for QA0SemiPassOnly MOUSes
• BUG: ICT-16653: now there is an informative error message when opening a weblog fails because it is too big

 

DRA:

• ICT-16769: in the QA2 Dashboard, you can now search by ‘QA3 ongoing’ or ‘non-QA3’. Active QA3 cases are highlighted in red in the results table.
• ICT-16767: Fixes/enhancements to the data reducer add/management options

 

 

AQUA 2020MAR/APR release notes

QA0:

• ICT-13770: fluxes from aoscheck displayed for Calsurvey and Fluxcheck observations
• ICT-15792: reasons for QA0 and QA2 semi-pass/fail can be captured at the QA0 stage from a pull-down list
• ICT-16405: QA0 bandpass, flux and phasecal fluxes are written to test database for QA0 PASS and SEMI-PASS
• ICT-16370: EF set to 0.2 if a mosaic is only partly complete (for interferometry)
• ICT-16314: PENDING_FLUXCAL conditions slightly changed to accommodate Band 4 grid data for very bad observing conditions
• ICT-15766: remove ArrayEB from AQUA
• ICT-14153: warnings when wvr correction < 1 and remcloud should be used
• ICT-12215: allow sorting by PENDING flag in the search results table
• BUG: ICT-16424: aoscheck flags should be visible from both the QA0 and the QA2 interface

QA2:

• ICT-16239: elongated beam warning removed for ACA MOUSes
• ICT-16220: in the ‘Finish’ pop-up, the RMS from the latest PL report is now entered by default. Note that the time stamp used to determine the latest entry in the database is the ReportDate (not the timestamp of the PL run, or the time it was uploaded).
• ICT-16199: in the Advanced search, it is now possible to search by all QA3 Fail reasons in one go
• ICT-16060: for TP OUSes with multiple sources, the representative source (to be used for the QA2 assessment) is now highlighted in the Image Sensitivity table
• ICT-13770: using the option “changed the state by mistake” as a non-obvious transition reason, the previous processing method is hidden from the tabs and the data processing methods
• BUG: ICT-16552: link broken for a specific MOUS
• BUG: ICT-16534: time-constrained pre-2016. Projects are now at least loaded into AQUA, although some of the information is missing (since no processing flags were assigned at that time)

Affects QA0 and QA2:

• ICT-15800: improvements to JIRA tickets opened from AQUA: the default assignee is now ade-planners and some extra information is given at QA0 (e.g. shiftlog output, median Tsys, plots from AQUA-QA0)
• BUG: ICT-16505: zcomet empty page errors fixed

PROMO:

• ICT-15411: E2E project codes can now be read

DRA:

• BUG: ICT-16471: some functionality stopped working

 

 

AQUA 2020FEB release notes

 

QA0:

• BUG: ICT-16242: no warning about recent flux measurement missing should be given when there is a Solar System flux calibrator
• BUG: ICT-16218: shadowing of antennas now taken into account in Execution Fraction calculation
• BUG: ICT-15802: median Tsys is used for Execution Fraction calculation if somehow the representative frequency is outside all basebands
• BUG: ICT-15794: only on-source scans followed by a phasecal scan are included in the Execution Fraction calculation
• BUG: ICT-15721: frequency axis no longer reversed for TP Tsys plots
• BUG: ICT-15429: atmosphere calibration results now shown at QA0 even if representative frequency is outside all basebands
• BUG: ICT-8255: parallactic angle range now consistent between AQUA and aU routine (to within a fraction of a degree)

 

QA2:

• BUG : ICT-16356 : saved searches now working again
• BUG: ICT-16355: Zk error fixed for a particular MOUS
• BUG: ICT-16243: EC values in SD PL review pop-up should now always be correct
• BUG: ICT-16229: sensitivity units for SD PL MOUSes should now be correctly pre-filled in the review pop-up. ONLY PARTIALLY VALIDATED – PLEASE CHECK CAREFULLY IN PRODUCTION!
• BUG: ICT-16217: AQUA now shows warning for insufficient sensitivity also for TP MOUSes
• BUG: ICT-16101: blank error for specific MOUS has been fixed
• BUG: ICT-16058: warning for beam size now uses mean beam in the calculation
• BUG: ICT-16001: links to PRTSPR tickets should now be correct also for old entries
• BUG: ICT-15710: processing tab can now be viewed for a particular MOUS
• BUG: ICT-16059: reporter of a JIRA ticket opened from AQUA should now be set to the person logged in; you will be required to enter your JIRA credentials before the ticket is opened. Please report any issues you encounter!

 

Affects QA0 and QA2:

• BUG: ICT-16384: attachments can now be downloaded & opened again
• ICT-15832: the observed (as well as expected) OFF positions should now be shown (at QA0, QA2 and also in SnooPI)

 

PROMO:

• BUG : ICT-14817: streamline data flow among AQUA, PROMO and PI

 

DRA:

• ICT-15900: show version in web interface
• ICT-16204: small fixes to the QA2 Dashboard
• ICT-15776: statistics for QA2 Dashboard: please check out the new stats tables that have been added below the MOUS list!

 

 

AQUA 2019NOV/DEC release notes

QA0:

 

• ICT-15078: write QA0 fluxes to (test) QA0 database
• ICT-15618: minor improvements/fixes, especially for TP EBs
• ICT-15617: improvements/safeguards for setting the EF
• ICT-13778: QA0+ results available in AQUA at EB and SB (cumulative results from QA0 PASS EBs observed so far) level

 

QA2:

 

• ICT-15626: capture image type and robust value for manual processing
• ICT-15437:  values for achieved sensitivity and beam are rounded
• ICT-15085: non-obvious transition improvements: search and multiple choice
• ICT-13870: small improvements to the QA3 interface
• ICT-12655: improvements to search functionality: counter for search results and negate options in Advanced Search
• ICT-15759: record QA3 history with reasons
• ICT-15757: add PLCal -> PLCal&Img as non-obvious transition
• ICT-15628: update QA2 report: mean beam and instructions for PI
• ICT-15625: N_ant in EB overview now shows the number of effective antennas
• ICT-9972: cosmetic changes to QA2 interface
• BUG: ICT-15542: Advanced search “Fully Observed from” option now working

 

DRA:

• ICT-12749: NEW: QA2 Dashboard created as a tab in the DRA tool: asa.alma.cl/dra-tool. The QA2 Dashboard gives an overview at the MOUS level according to specified criteria (e.g. per ARC) 
• ICT-15773: user-defined search and result display

 

 

AQUA 2019AUG and 2019OCT release notes (QA0 2019JUL/AUG deployed with 2019AUG, QA2 and APA only one deployment for 2019JUL/AUG/OCT)

 

2019JUL/AUG QA0 (deployed for the start of Cycle 7):

• ICT-13779: revise QA0 report, include extra information
• ICT-9085: incorporate OFF position check into AQUA
• ICT-14726: Execution Fraction automatically set to 1 for time-critical, solar and time override projects
• ICT-14704: checksource added to ‘Sources’ plot
• ICT-14582: when an EB goes to Pending, the computed Execution Fraction is kept (and not set to 1)
• ICT-14290: complex time constrains (relative dependencies between MOUSes, simultaneous 12-m and 7-m observations) are now correctly reported and checked for
• BUG: ICT-15293: automatic transition to Pending_Fluxcal fixed

 

2019OCT QA0:

• ICT-13172: automatically set QA0 state for gridcal survey EBs
• ICT-9840: allow creation of PRTSPR tickets from within the AQUA interface
• ICT-15426: for manual processing, the QA0 state can now be changed if the MOUS is in ReadyForReview
• ICT-13395: for TP observations, wrong warnings about missing observing intents have been removed
• BUG: ICT-15696: (empty) QA0 report generated if no aoscheck data available rather than a NPE being given
• BUG: ICT-15530: issue with computation of relative time windows fixed
• BUG: ICT-15325: transition to FullyObserved now working if EC > 0.9 times the expected executions
• BUG: ICT-15290: EF calculator is now picking up only available antennas
• BUG: ICT-14150: FINALLY, we fixed a long-standing issue of high proper motion QA0 TP Offset positions being incorrectly reported in AQUA

 

QA2:

• ICT-13576: before re-ingesting a MOUS, the new and previously ingested lists of QA0 PASS EBs are shown
• ICT-9840: allow creation of PRTSPR tickets from within the AQUA interface
• ICT-15425: date of last ingestion of products into archive is now shown in the Summary tab
• ICT-15191: the mean beam is now displayed and used for display of warning
• ICT-14936: there is now a link to the APA entries corresponding to a given MOUS in AQUA
• ICT-14882: EBs are now sorted chronologically in EB overview table
• ICT-14707: reasons for “non-obvious” transitions have been updated
• ICT-9218: complex time constraints (including relative dependencies between MOUSes, simultaneous 12-m and 7-m observations) are now correctly reported and checked for
• ICT-15028: reasons for “Supplemental Manual Imaging” now selected from a drop-down list of reasons (and can therefore be easily tracked for statistics)
• BUG: ICT-15362: e-mails now also sent to users in cc
• BUG: ICT-15175: phasecal fluxes are now also ingested into source catalogue after moving on to imaging after the PipelineCalibration stage (not just when PipelineCalAndImg was used)
• BUG: ICT-15027: units now converted correctly when editing achieved sensitivity
• BUG: ICT-14914: list of observing modes in advanced search has now been fixed
• BUG: ICT-14599: Zk error fix
• BUG: ICT-13633: NPE fix
• BUGs already patched into production:
  •  ICT-15538: image sensitivity from pipeline now correctly scaled and reported by AQUA
  • ICT-15232: transition to DeliveryInProgress fixed

 

APA:

• ICT-14917: Improvement for a user friendly APA GUI, filter for searching MOUS entries in staging area/ weblogcache/Pl runs/PL rund in error status
• ICT-14822: APA weblog removed automatically after approx. 8 minutes
• ICT-15228 APA-displaying Weblog by static url should redirect to APA REST API, this is meant to catch the "white label error" issue and open the weblog redirecting to the REST API

 

 

2019JUN deployment (includes 2019MAY+2019JUN release)

QA0:

• ICT-14530: Execution Fraction can now be computed directly in AQUA, which is much faster than calling the external script as before
• ICT-13404: Execution Fraction takes into account shadowing
• ICT-14708: EBs stuck in PENDING_FLUXCAL will go to UNSET after 15 days
• ICT-13781: requirements for valid flux calibrators have been updated and are now dependent on spectral index
• ICT-13951: a new bandpass tab is displayed
• ICT-13777: aoscheck results are now automatically read by AQUA without needing to press a button
• ICT-14890: make images provided by new aoscheck accessible to AQUA
• BUG: ICT-15076 : aoscheck QA0 report is again pasted into the final comments box
• BUG: ICT-14152: phase rms is now correctly reported in microns
• BUG: ICT-13967: flagging commands generated by flag builder are now correct also for TP antennas used in interferometric observations

 

QA2:

• ICT-13266 (and ICT-15021): AQUA is now displaying the achieved image sensitivity (scaled to the PI requested bandwidth for sensitivity) and beam from pipeline. These values are automatically transferred to the relevant fields in the ‘Finish’ pop-up, but can be edited if necessary. Warnings are displayed if the sensitivity is too poor or the beam does not conform to the Cycle 6 QA2 standards.
• ICT-14695: there is now a “Supplemental Manual Imaging” flag that can be added manually to mark pipeline-processed OUSes that have extra manual images added
• ICT-13947: phasecal fluxes from pipeline are now ingested into the SC (only for S/N > 200) . This currently works only for CalAndImg processing, not for cal-only (bug to be fixed in 2019AUG).
• ICT-14231: the ‘Products’ pop-up is now available for the last processing run of a given type (e.g. Cal or Img)
• ICT-14756: additional QA2 SEMI-PASS/FAIL reasons added to drop-down list
• ICT-14706: ‘Next Step’ options increased for ProcessingProblem OUSes
• ICT-13915: for EU manual processing, an extra e-mail alert is now sent to AOG once a data reducer has accepted an assignment
• BUG: ICT-14541: the correct processing recipe is now shown in the processing overview table even after delivery of the OUS has started
• BUG: ICT-13967: when TP antennas are used for IF observations the flagging command generated by the flag builder is now correct
• BUG: ICT-14898: data reducers can be assigned again (patched into 2019APR production)

 

APA:

• ICT-14346 : the weather reports are included in the qa0 reports for each EB (and delivered to the PI).
• ICT-14580 : mini-weblogs (weblogs from manual procedure) are sent to the PI.
• ICT-14581 : SD mini-weblogs are improved with python scripts shown in print (and images)
• BUG : ICT-14700 : other causes for white label error issues are investigated. Specifically, the APA clean up strategy is tuned to allow for already delivered projects the weblog to be available from the weblog cache.

 

 

2019APR deployment (includes 2019MAR+2019APR release)

QA2:

• BUG: ICT-14494: this fixes a bug whereby an error message about ingestion of the wrong type of products was shown when selecting PL Cal&Img after PLCal had been reviewed (but not ingested)
• ICT-14168: flag editor improvements, improve visibility of text
• ICT-14167: improvements to “Show products” pop-up: files alphabetically sorted, pop-up is larger
• ICT-14165: display EB UID in flag builder pop-up
• ICT-14164: if products have already been ingested into the archive for a MOUS, the type of products is displayed in the OUS summary tab

 

APA:

• BUG: ICT-11497: correctly label owner of products (EU/NA/EA/JAO)
• ICT-14125: include NGAS info when saving weblog (for diagnostic purposes)
• ICT-14334: update APA to work with new ProductIngestor java application

 

 

2019FEB deployment (bug fixes only)

QA0:

• BUG: ICT-12774: TP rectangles that are offset from the source coordinates should now be correctly displayed

 

2018DEC deployment

QA0:

• ICT-13405: the automatic cap on the EF is increased to EF=4 for TP EBs (the cap remains 1.5 for interferometry EBs)

• ICT-13399: an SB should now go to fully observed if the EC > 90% of the expected number of executions
• ICT-13527: fully flagged antennas now appear in red in baseline plot
• BUG: ICT-13924: TP OFF positions should now be correct for ephemeris objects
• BUG: ICT-13684: TP OFF positions should not be used in the on-source time calculation
• BUG: ICT-13624: source coverage correctly calculated for high proper motion objects

 

QA2:

• ICT-13461: if calibration product ingestion fails, the state transition to ReadyForProcessing is not made
• ICT-13103: the interface between AQUA and DRA has been improved: AQUA allows a data reducer to be requested (DR can accept or reject), filters by DR availability entered in the DRA Tool
• ICT-12994: improved tracking of QA2 workflow: search by OUSes that were once QA2 FAIL, by FAIL reason. Non-obvious state transitions require a reason to be given.
• ICT-13660: DR users can now use the flag builder
• ICT-13653: both the last calibration and the last imaging weblogs can be seen from AQUA after MOUS delivery
• BUG: ICT-13882: can now search by DR and DRM at the same time
• BUG: ICT-13569: artificial precision no longer added to time-range flags
• BUG: ICT-13556: small rms values now accurately displayed in AQUA
• BUG: ICT-14088: Tsys flags now displayed in EB summary table
• BUG: ICT-13913: requested AR should now always be correctly displayed in the QA2 report
• BUG: ICT-13912: fixed predicted beam warning prediction after calibration
• BUG: ICT-13688: it should no longer be possible to get an OUS in the state where the QA2 values are not saved and cannot be entered
• BUG: ICT-13618: QA2 status now shown also in html QA2 report

APA:

• ICT-12875: Ingest Weather Report using the Aqua Pipeline Agent
• ICT-13768: Improvements to the mini-weblog for manual data products
• BUG: ICT-12983: APA: java.lang.NullPointerException in method getDirectoryContentFrom Disk
• BUG: ICT-13105: Whitelabel Error Page This application has no explicit mapping for error, so you are seeing this as a fallback. There was an unexpected error (type=Not Found, status=404)
• BUG: ICT-13245: Generation of weblog from manual package foes not pick up the optional scriptForImagingPrep.py

 

 

2018OCT deployment

QA0:

• ICT-13405 : max. cap for Execution Fraction increased to EF=4
• ICT-13399: EB will go to FullyObserved if the average EF over all QA0 PASS executions > 0.9
• BUG: ICT-13504: expected number of antennas and Cycle corrected for E2E projects

 

QA2:

• ICT-13411: updated workflow for manual processing – this includes support for the new ManualCalAndImg flag, which should from now on be the default for fully manually processed OUSes. ManualCalibration products need to be packaged & ingested before moving to ManualImaging, if the two steps need to be split in the workflow. Re-ingestion of manual products is now supported.
• ICT-13376: new facility to edit Tsys flags in the AQUA GUI (same interface as for the QA0 and QA2 flags)
• ICT-13154: QA3 is now supported by AQUA – start by pressing the ‘Do QA3’ button and then follow the normal processing workflow. You can change the proprietary time in the ‘Do QA2’ pop-up once you get to the stage of setting the QA2 flag.
• BUG: ICT-13606: fix re-ingestion parameter for QA0 semi-pass only processing workflow

 

APA:

• ICT- 13239: Release info on the internal science portal can now be accessed from APA GUI
• ICT-13171: when an OUS has had both manual and pipeline processing done, the last weblogs for both will be accessible from AQUA even after delivery
• ICT-12963: pipeline runs in error status now have the MOUS ID and a link to AQUA
• ICT-13834: support for ICT-13376 workflow
• ICT-13463: support for data release info in ICT-13154
• ICT-13434: support for the ManualCalAndImg processing flag
• ICT-13436: support for separate manual cal/img re-ingestion in ICT-13411
• ICT-13751: APA to make ReadyForReview transition for manual workflow. This transition will be made only if the ‘Awaiting DRM approval’ has been set (i.e. the workflow has been properly followed and any QA2 parameters have been entered).
• ICT-13200: improve error reporting

 

2018AUG deployment (containing 2018JUL+2018AUG releases)

Affects QA0 and QA2:

• ICT-13187: consider only VALID source catalogue measurements in AQUA

QA2:

• ICT-9218 : properly display time constraints specified in SB
• ICT-13248: disable 'Do QA2' button for OUSes in DeliveryInProgress and Delivered
• ICT-13006: disable editing of QA2 comment for DeliveryInProgress and Delivered
• ICT-13014: check product processing recipe before (re)-ingestion
• ICT-12964: revised phasecal flux ingestion for QA2 PASS science SBs (into the test source catalogue for now, will move to the production source catalogue after testing period)
• ICT-8565: facility for editing pipeline flags via a GUI in AQUA
• BUG: ICT-13419: remove superfluous pre-ingestion check preventing ingestion of calibration-only products
• BUG: ICT-13369: remove pre-ingestion check preventing ingestion of manual products
• BUG: ICT-13331: long-term fix for QA2 status appearing in archived QA2 report
• BUG: ICT-13363: final QA2 comment does not appear in archived QA2 report
• BUG: ICT-13247, ICT-12950: fix issues with PL flag builder
• BUG: ICT-12930: search results between QA2 and Protrack differ
• BUG: ICT-12606: fix issue with QA2 states/comments getting lost if an OUS is open in more than one tab

 

QA0:

• BUG: ICT-13280: take out automatic PENDING_FLUXCAL QA0 state for grid survey observations, allow QA0 PASS to be set
• BUG: ICT-12976: remove special mode = VLBI for gridsurvey data
• BUG: ICT-13268, ICT-13017: NullPointerException

 

APA:

• ICT-11669: Change user ID from 'webaquatoapa' to 'almaobservatory' 
• ICT-12182: Re-populate the APA with deleted aqua-pipeline reports
• ICT-13067: reclaim Weblogs that were last accessed one month ago
• ICT-12451: Disk usage charts in home directory of APA GUI needs implementation
• ICT-13445 About the addition of the MOUS information on the "Pipeline run directories in error status" tab

 

DRA Tool:

• BUG: ICT-13147: cannot add a data reducer from JAO

 

 

2018JUN deployment (containing 2018MAY+2018JUN releases)

NEW!!! DRA Tool:

• ICT-10321: we have a new DRA (Data Reducer Assignment) tool!!! This will replace the DRM Tool functionality and additionally allow data reducers to manage their own availability. Component lead: Alfonso Trejo.

QA2:

2018MAY:

• ICT-10321: we have a new DRA (Data Reducer Assignment) tool!!! This will replace the DRM Tool functionality and additionally allow data reducers to manage their own availability. Component lead: Alfonso Trejo.
• BUG: ICT-12028: issue with PT/AQUA inconsistent rms values is fixed

2018JUN:

• ICT-12842: new QA2 FAIL reason: rms dynamic range limited
• ICT-12822: data reducer availability (from DRA tool) can be seen from AQUA before assigning a data reducer
• ICT-12732: improvements to instruction text in QA2 reports, different versions for interferometry and TP OUSes
• ICT-12835: the ingestion of phasecal fluxes from PI observations into the source catalogue has been temporarily disabled

QA0:

2018JUN:

• ICT-12820: more info from aoscheck to be shown in the AQUA GUI, changes made to the source coverage plots, the Atmosphere tab, the Phase tab. The Focus tab has been removed. New tabs: Calibrators, Antennas, Amplitude. Before setting an OUS to FullyObserved, AQUA will check this with the user.
• ICT-12756: automatically set PENDING+Fluxcal QA0 state when a valid flux measurement is missing for the amplitude calibrator (this was previously only a warning)
• BUG: ICT-12705: parallactic angle range in sessions fixed
• BUG: ICT-12292: “manual projects” no longer displayed

APA:

2018JUN:

• ICT-11904: QA2/APA: save QA2 report and associated QA0 reports to APA staging area. The reports will now be included in the delivered package.

• ICT-12121: APA -include flag QA0SemipassOnly
• ICT-12574: Enable Client ID for Oracle connection

2018MAY:

• ICT-12423: Include git revision in spring boot apps
• BUG: ICT-12551: APA did not create automatic log file after 14-Mar deployment (2018FEB)

 

2018APR deployment (containing 2018MAR+2018APR releases)

QA0 and QA2:

2018MAR:

• ICT-11459: the ASDM data is precomputed so that loading EB/OUS info in both QA0 and QA2 AQUA should be much faster

2018APR:

• BUG: ICT-12535: ephemeris coverage plots should now be displayed again – AQUA stopped doing this for some reason
• BUG: ICT-12483: coverage information should now be fixed for TP observations. This could not be fully implemented due to issues reading the relevant data in the ASDM. The size and orientation of the rectangular area should now be correct, however the observed rectangle may still be offset from the requested position in the QA0 plot. We are working on a long-term fix for this.

QA2:

2018MAR:

• ICT-12194: in the Advanced Search one can now search for OUSes by a string in the comments (basic functionality only; more sophisticated OR/AND functionality to come in ICT-12655 in a future release), by any combination of data reducer/DRM, and pretty much all possible combinations of parameters
• ICT-12193: the initial values of the QA2 parameters (sensitivity, beamsize) entered in the ‘Finish’ dialogue can now be edited by either the assigned data reducer or anybody with the DRM role in the Summary tab during the reviewing phase. The ‘Finish’ button is now disabled once the ‘Awaiting DRM decision’ flag has been set.
• ICT-12234: Warning pop-up if DRM tries to set a QA2 PASS/SEMI-PASS state when they should not (QA2 parameters have not been entered, processing doesn’t include imaging, OUS is in the wrong state)
• ICT-12231: ‘Re-observe’ option no longer available from ‘Finish’ dialogue for DRM users
• BUG: ICT-12377: re-saving user-defined searches should now work correctly

2018APR:

• ICT-11942: Support QA0 semi-pass only workflow
• ICT-11996: Re-ingest / new upload option in AQUA after ingestion error
• ICT-12235: Further improvements to e-mail alerts: alerts to CS, e-mail alert subject contains new state, ‘Finish’ comments included in alerts, DR QA2 alert contains QA2 flag and comment
• ICT-12230: Display the QA2 history, including all Final QA2 comments and Fail reasons
• BUG: ICT-12741: when ingestion fails, the notification pop-up now shows possibly useful information
• BUG: ICT-12743: OUSes following the new QA0 semi-pass only workflow now show up in AQUA

QA0:

2018APR:

• ICT-7630: use Tsys at representative frequency rather than the average
• ICT-12199: Display more info from aoscheck in AQUA in the summary and phase tabs
• ICT-12232: The phase tab summary table now shows the spw central frequency (not the BB central frequency) and includes the bandwidth of the spectral window
• BUG: ICT-12619: spectral window rest frequencies should now be correctly calculated

APA:

2018APR:

• ICT-11145: Pipeline Agent: create a mini-weblog also for manual Single Dish processing
• ICT-12351: Handling of Pipeline run directories before delivery

 

Patched into 2018FEB (12.04.2018 version)

QA0:

• ICT-12061: pending fluxcal EBs are now checked once per hour and can also be checked manually for new fluxcal information in the QA0 bulk status update tool
• BUG: ICT-12487: QA0 Calsurvey EBs should now be included in the ‘Calibration’ search results
• BUG: ICT-12464: QA0 report should now be created even if the last scan is incomplete

 

2018FEB deployment

QA0 and QA2:

• Display for Walsh switching (mirror spectral windows) has been improved (ICT-10959)
• Release info is now available from AQUA GUI (ICT-11407)

QA2:

• Adding users as Comment Recipients should now be faster (ICT-11922)
• BUG: frequency displayed as spw central frequency was in fact the BB central frequency (ICT-12008)

QA0:

• Changing of QA0 state or EF is now prevented while OUS is being processed and after QA2 (ICT-10593)
• Antenna baseline is shown when hovering over point in phase rms plot (ICT-9550)
• Band of the pointing observations is shown (ICT-8567)
• BUG: an offset was wrongly reported between expected and observed position for Proxima Centauri (ICT-11039)

APA:

• ICT-11697 : disk-stats.sh script POSIX format issue (this is concerning the visualization in the APA GUI of the disk usage/availability)
• ICT-11709 : introduce rate limiting (for requests to the APA GUI) 
• ICT-12054 : APA - select rows with checkboxes (check boxes in each tab) 
• ICT-12060 : APA -fix popup
• ICT-12081 : APA -set PipelineRunDir to ERROR when weblog ingestion into NGAS fails
• ICT-12082 : APA -set status to PROCESSED when realign problem is solved