diff --git a/flyte_demo/flyte_demo/whats_next.md b/flyte_demo/flyte_demo/whats_next.md index 5271b20..f714aca 100644 --- a/flyte_demo/flyte_demo/whats_next.md +++ b/flyte_demo/flyte_demo/whats_next.md @@ -14,17 +14,17 @@ However, we've barely scratched the surface of all the different use cases that Flyte supports. Take a look at the following resources to experience the full power of Flyte! -- **[👟 Getting Started](https://docs.flyte.org/en/latest/getting_started/index.html)**: +- **[👟 Getting Started](https://docs.flyte.org/en/latest/quickstart_guide.html)**: to get started with Flyte in your own environment check out this quickstart guide. -- **[📖 User Guide](https://docs.flyte.org/projects/cookbook/en/latest/index.html)**: - learn more about the features that make Flyte super powerful 💪, like the built-in [file](https://docs.flyte.org/projects/cookbook/en/latest/auto/core/flyte_basics/files.html#sphx-glr-auto-core-flyte-basics-files-py) and [directory](https://docs.flyte.org/projects/cookbook/en/latest/auto/core/flyte_basics/folders.html#sphx-glr-auto-core-flyte-basics-folders-py) types, [Flyte Decks](https://docs.flyte.org/projects/cookbook/en/latest/auto/core/flyte_basics/deck.html#sphx-glr-auto-core-flyte-basics-deck-py), [dynamic workflows](https://docs.flyte.org/projects/cookbook/en/latest/auto/core/control_flow/dynamics.html#sphx-glr-auto-core-control-flow-dynamics-py), [intratask checkpoints](https://docs.flyte.org/projects/cookbook/en/latest/auto/core/control_flow/checkpoint.html), and [raw container tasks](https://docs.flyte.org/projects/cookbook/en/latest/auto/core/containerization/raw_container.html#sphx-glr-auto-core-containerization-raw-container-py). -- **[📚 Tutorials](https://docs.flyte.org/projects/cookbook/en/latest/tutorials.html)**: - check out examples of how to put all of Flyte's constructs together to build end-to-end data and ML workflows, like [single- and multi-gpu training with pytorch](https://docs.flyte.org/projects/cookbook/en/latest/auto/case_studies/ml_training/mnist_classifier/index.html), [feature engineering with Feast](https://docs.flyte.org/projects/cookbook/en/latest/auto/case_studies/feature_engineering/feast_integration/index.html), and [nucleotide sequence querying for bioinformatics](https://docs.flyte.org/projects/cookbook/en/latest/auto/case_studies/bioinformatics/blast/index.html). -- **[🔌 Integrations](https://docs.flyte.org/projects/cookbook/en/latest/integrations.html)**: - use Flyte with the tools you know and love like [SQL](https://docs.flyte.org/projects/cookbook/en/latest/auto/integrations/flytekit_plugins/sql/index.html), [Papermill](https://docs.flyte.org/projects/cookbook/en/latest/auto/integrations/flytekit_plugins/papermilltasks/index.html), [Pandera](https://docs.flyte.org/projects/cookbook/en/latest/integrations.html), [Sagemaker](https://docs.flyte.org/projects/cookbook/en/latest/auto/integrations/aws/sagemaker_training/index.html), and [Airflow](https://docs.flyte.org/projects/cookbook/en/latest/auto/integrations/external_services/airflow/index.html). +- **[📖 User Guide](https://docs.flyte.org/en/latest/index.html)**: + learn more about the features that make Flyte super powerful 💪, like the built-in [file](https://docs.flyte.org/en/latest/api/flytekit/types.builtins.file.html) and [directory](https://docs.flyte.org/en/latest/api/flytekit/types.builtins.directory.html) types, [Flyte Decks](https://docs.flyte.org/en/latest/user_guide/development_lifecycle/decks.html), [dynamic workflows](https://docs.flyte.org/en/latest/user_guide/advanced_composition/dynamic_workflows.html), [intratask checkpoints](https://docs.flyte.org/en/latest/user_guide/advanced_composition/intratask_checkpoints.html), and [raw container tasks](https://docs.flyte.org/en/latest/user_guide/customizing_dependencies/raw_containers.html). +- **[📚 Tutorials](https://docs.flyte.org/en/latest/flytesnacks/tutorials.html)**: + check out examples of how to put all of Flyte's constructs together to build end-to-end data and ML workflows, like [single- and multi-gpu training with pytorch](https://docs.flyte.org/en/latest/flytesnacks/examples/mnist_classifier/index.html), [feature engineering with Feast](https://docs.flyte.org/en/latest/flytesnacks/examples/feast_integration/index.html), and [nucleotide sequence querying for bioinformatics](https://docs.flyte.org/en/latest/flytesnacks/examples/blast/index.html). +- **[🔌 Integrations](https://docs.flyte.org/en/latest/flytesnacks/integrations.html)**: + use Flyte with the tools you know and love like [SQL](https://docs.flyte.org/en/latest/flytesnacks/examples/sql_plugin/index.html), [Papermill](https://docs.flyte.org/en/latest/flytesnacks/examples/papermill_plugin/index.html), [Pandera](https://docs.flyte.org/en/latest/flytesnacks/examples/pandera_plugin/index.html), [Sagemaker](https://docs.flyte.org/en/latest/flytesnacks/examples/sagemaker_inference_agent/index.html), and [Airflow](https://docs.flyte.org/en/latest/flytesnacks/examples/airflow_agent/index.html). - **[🚢 Deployment](https://docs.flyte.org/en/latest/deployment/index.html)**: - deploy a Flyte cluster using [AWS](https://docs.flyte.org/en/latest/deployment/aws/manual.html#deployment-aws-manual) or [GCP](https://docs.flyte.org/en/latest/deployment/gcp/manual.html#deployment-gcp-manual), and learn how to configure it to enable Flyte's - [backend plugins](https://docs.flyte.org/en/latest/deployment/plugin_setup/index.html#deployment-plugin-setup). + deploy a Flyte cluster using AWS or GCP, and learn how to configure it to enable Flyte's + [backend plugins](https://docs.flyte.org/en/latest/deployment/plugins/index.html). ## Write your own workflows diff --git a/flyte_demo/flyte_demo/workflows/iterating.md b/flyte_demo/flyte_demo/workflows/iterating.md index 39bcf9e..0abf782 100644 --- a/flyte_demo/flyte_demo/workflows/iterating.md +++ b/flyte_demo/flyte_demo/workflows/iterating.md @@ -9,13 +9,13 @@ features, which you can see in `iterating.py`. ## Structured Datasets Flyte comes with its own type system, supporting almost all of the -[built-in Python types](https://docs.flyte.org/projects/cookbook/en/latest/auto/core/type_system/flyte_python_types.html#sphx-glr-auto-core-type-system-flyte-python-types-py), -but it also exposes a [`StructuredDataset`](https://docs.flyte.org/projects/cookbook/en/latest/auto/core/type_system/structured_dataset.html) type, +[built-in Python types](https://docs.flyte.org/en/latest/user_guide/data_types_and_io/index.html), +but it also exposes a [`StructuredDataset`](https://docs.flyte.org/en/latest/user_guide/data_types_and_io/structureddataset.html) type, which we can use to create types for objects like `pandas.DataFrame`s. ## Caching -Add `cache=True` with a `cache_version` string to the `@task` decorator to [cache](https://docs.flyte.org/projects/cookbook/en/latest/auto/core/flyte_basics/task_cache.html#sphx-glr-auto-core-flyte-basics-task-cache-py) the output of the task. This +Add `cache=True` with a `cache_version` string to the `@task` decorator to [cache](https://docs.flyte.org/en/latest/user_guide/development_lifecycle/caching.html) the output of the task. This will ensure that you don't re-run the task if you give it the same exact inputs. ## Retries diff --git a/flyte_demo/flyte_demo/workflows/parallelism.md b/flyte_demo/flyte_demo/workflows/parallelism.md index 61f4ccb..9394742 100644 --- a/flyte_demo/flyte_demo/workflows/parallelism.md +++ b/flyte_demo/flyte_demo/workflows/parallelism.md @@ -5,7 +5,7 @@ Flyte also provides built-in constructs for parallelizing your tasks. In this example, we're extending our training workflow to implement a simple -gridsearch workflow leveraging the [`map_task`](https://docs.flyte.org/projects/cookbook/en/latest/auto/core/control_flow/map_task.html#) construct. +gridsearch workflow leveraging the [`map_task`](https://docs.flyte.org/en/latest/user_guide/advanced_composition/map_tasks.html) construct. When using `map_task`s, the `@task` function being mapped over can take only a single argument. To implement our gridsearch workflow, we update our workflow