Currently, certain methods in the DAGs do not have proper error handling.
For example, this pull_survey_cto_data.get_form_data method
always returns the response from the remote API, regardless if the response is valid, the status code is erroneous...
Acceptance Criteria
Identify parts of the DAG where sensitive requests are being made (remote APIs, DB operations...) and use Python exception handling as you see fit:
- wrap in
try/except blocks
- log the exception using
logger.exception(e)
- ...
Currently, certain methods in the DAGs do not have proper error handling.
For example, this
pull_survey_cto_data.get_form_datamethodconnectors/DAGs/pull_survey_cto_data.py
Line 61 in 9e16ecf
Acceptance Criteria
Identify parts of the DAG where sensitive requests are being made (remote APIs, DB operations...) and use Python exception handling as you see fit:
try/exceptblockslogger.exception(e)