20 Matching Annotations
  1. Mar 2023
    1. So, let’s sum up the pros and cons of each tool:

      Summary of pros/cons of Airflow, Kubeflow and Prefect

    2. The airflow environment must have all the libraries that are being imported in all DAGs. Without using containerization all Airflow pipelines are launched within the same environment. This leads to limitations in using exotic libraries or conflicting module versions for different projects.

      Main con of Airflow

    3. Prefect is a comparatively new but promising orchestration tool that appeared in 2018. The tool positions itself as a replacement for Airflow, featuring greater flexibility and simplicity. It is an open-source project; however, there is a paid cloud version to track workflows.
    4. Airflow has been one of the most popular orchestrating tools for several years.

      (see the graph above)

  2. Jan 2023
  3. Oct 2022
  4. Jan 2022
  5. Nov 2021
  6. Oct 2021
    1. few battle-hardened options, for instance: Airflow, a popular open-source workflow orchestrator; Argo, a newer orchestrator that runs natively on Kubernetes, and managed solutions such as Google Cloud Composer and AWS Step Functions.

      Current top orchestrators:

      • Airflow
      • Argo
      • Google Cloud Composer
      • AWS Step Functions
  7. Jul 2021
    1. Prof Cath Noakes #Ventilate 😷 💙 on Twitter: “A thread today about windows and ventilation, and some things you can do to make the most of your windows for comfort and infection risk 1/” / Twitter. (n.d.). Retrieved July 19, 2021, from https://twitter.com/CathNoakes/status/1416368008801492994

  8. Feb 2021
  9. Feb 2020
  10. Dec 2019
  11. Sep 2019
  12. Aug 2019
  13. Apr 2019
  14. Dec 2018