[AkshayShah03]

Issue #, if available: N/A

Description of changes:

#5816 made _JobSettings add the sagemaker-feature-store-pyspark install and JAR-copy commands to pre_execution_commands for Spark jobs. They are added before the check that only one of pre_execution_commands and pre_execution_script is set. So

@remote(spark_config=SparkConfig(), pre_execution_script="setup.sh", ...)

always fails with ValueError: Only one of pre_execution_commands or pre_execution_script can be specified!, even though the user only set the script. This worked in v2. The commands were also appended to the caller's own pre_execution_commands list in place.

This change:

• runs the mutual-exclusion check on the user's configuration, before the Spark commands are added;
• leaves the setup to the user's script when one is set, since only one of the two can run, and logs a warning that sagemaker-feature-store-pyspark isn't installed automatically;
• appends the Spark commands to a copy of the user's list.

Testing:

• New _JobSettings tests:
  • Spark plus a script doesn't raise;
  • the user's command list isn't modified;
  • the user supplying both commands and a script still raises.
• The first two fail before this change.
• tests/unit/remote_function: 233 passed.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.