Explore tweets tagged as #pythonoperator
@Jhonthanortizh
Jhonathan
4 years
Operators Son objetos de Airflow que definen una tarea, ejemplos de ellos pueden ser PythonOperator el cual ejecuta una funcion de python o BashOperator el cual ejecuta un comando de bash. Empieza a tener sentido, no? Todo esto va a dentro de un DAG
1
0
1
@meoflaxz
meoflaxz
2 years
2 method of defining job/task in Apache Airflow. Both resulting the same output - calling API and printing the result. Pythonoperator is a built in module to execute Python function, while Taskflow API provides a pythonic structure approach.
4
2
31
@overflow_meme
Meme Overflow
6 years
Why use CustomOperator over PythonOperator in Apache Airflow? https://t.co/yCXTHnVC7H
0
0
0
@PAClearning
Probably Approximately Correct
2 years
@pacmannai Kalau kita lihat kodenya, bentuknya begini, nih. Task yang berupa PythonOperator akan memanggil sebuah fungsi Python denga nama "extract", yang dipanggil dalam parameter "python_callable". Sekalian deh kami tampilin DAG run lagi haha
1
1
0
@Jhonthanortizh
Jhonathan
4 years
Y así quedaría nuestro primer DAG. Nuestras dos tareas son las funciones definidas luego de los imports. Luego armamos nuestro DAG y ya que lo que queremos ejecutar es código python usamos PythonOperator, para cada una de nuestras task. Y al final definimos las dependencias.
1
0
0
@overflow_meme
Meme Overflow
7 years
Airflow: how to use xcom_push and xcom_pull in non-PythonOperator https://t.co/sExmS8Hb2g
0
0
0
@BowTied_Raptor
BowTied_Raptor|Data Science & Machine Learning 101
3 years
3. Operators: These are the building blocks of workflows. Each operator is a single task in a workflow. Airflow has several built-in operators (PythonOperator, BashOperator, etc.) and you can also define your own.
1
0
1
@anandrishv
Rishav
4 months
i had import pythonoperator but when claude generated code then it gave the code of Airflow 2x but it is Airflow 3.x running so i got confused and went to the official docs and read the operators section and god the right code
0
0
0
@parmardarshil07
Darshil | Data Engineer👨🏻‍🔧
2 years
6. Operators There are many different operators you can use for a specific task They determine WHAT gets done. 1. BashOperator: Executes a bash command. 2. PythonOperator: Executes a Python function. 3. PostgresOperator: Executes SQL on a Postgres database. and many more!
1
1
14
@data_dec
Data Engineering Community (DEC)
3 months
💡Airflow Operators: The Building Blocks In Airflow, tasks are created using Operators. They’re the “actions” your workflow performs. Here are the common ones for data engineers: ◉BashOperator → run bash commands. ◉ PythonOperator → run Python functions. Example:
2
4
9
@DrMattCrowson
Reluctant Quant
3 years
0
0
0
@benbendemo
大西洋暖流
6 years
stackoverflow上面提了一个关于Airflow的问题,有谁可以帮忙解答吗。 https://t.co/cZubQgOe2a
0
0
0
@DrMattCrowson
Reluctant Quant
5 years
RT Data Engineering 101 – Getting Started with Python Operator in Apache Airflow https://t.co/SEPCfX6x3t #Beginner #DataEngineering #Python #ApacheAirflow #pythonoperator
0
0
0
@haruzion_
10baaaan
5 years
airflowのmysql-operator機能もショボいし、ドキュメントも少ないからもう使わなくてもいいかな。。PythonOperatorで自分でコネコネした方が良さそう。
0
0
1
@hadia__siddiqui
hadia siddiqui
4 months
you don’t know these Python operators, you’re not really coding yet 🐍 #pythonlearning #pythonprogramming #pythonoperator #pythontips #backenddev
0
0
0
@WILAcademy
Win in Life Academy
3 years
Python's compare operator For any queries on the Data analytics & Data Science course Apply Now: 🌐 https://t.co/8rW1xnFKsB Contact us: 📞9035613728, 8904229202 #python #pythonoperator #wininlifeacademy #DataScience #machinelearning #pythonprogramming#pythoncode @WILAcademy
0
0
0
@gaminessium
ガミネ
6 years
独自 Operator を実装するより、PythonOperator 系の標準モジュールを利用して、必要な処理を Airflow に依存しない環境で構築したほうがいいと思う
0
0
0
@legoboku
Yohei Onishi 🇸🇬
1 month
GCP ComposerでPythonOperatorのタスクでメモリを多めに使う処理を走らせ、worker podのメモリ上限に達すると、kubernetesのpod preemptionによってworker podが削除されてしまう。また、あらゆるpodがノードを共有してるので、ノードがresource
1
0
1