ci: Update workflows and Dockerfile for pre-releases

[pingsutw]

This pull request updates several Dockerfile configurations across the project to include the --pre flag when installing flytekit and its plugins. This ensures that pre-release versions of the packages are used, likely to test or adopt new features and fixes early.

Changes to Package Installation:

• Core Flytekit Installation:

  • Added the --pre flag to the uv pip install command for flytekit in the main Dockerfile. This allows pre-release versions of flytekit to be installed. (Dockerfile, DockerfileL25-R25)

• Flytekit Plugins:

  • Updated the Dockerfile.connector to include the --pre flag for installing flytekit[connector] and other plugins like flytekitplugins-airflow, flytekitplugins-bigquery, and flytekitplugins-k8sdataservice. (Dockerfile.connector, [1] [2]
  • Modified the Dockerfile.dev to add the --pre flag for installing flytekit and its dependencies from the master branch. (Dockerfile.dev, Dockerfile.devL38-R38)
  • Updated plugin-specific Dockerfiles (e.g., flytekit-flyteinteractive, flytekit-openai, flytekit-spark, and flytekit-sqlalchemy) to use the --pre flag for installing their respective plugins and flytekit. (plugins/flytekit-flyteinteractive/Dockerfile, [1]; plugins/flytekit-openai/Dockerfile.batch, [2]; plugins/flytekit-spark/Dockerfile, [3]; plugins/flytekit-sqlalchemy/Dockerfile, [4]

Summary by Bito

This pull request updates Dockerfile configurations to include the --pre flag for installing flytekit and its plugins, enabling the use of pre-release versions. The changes ensure all relevant components are aligned with this new installation strategy for early testing and feature adoption.