![]() ![]() Trying to set mount_tmp_dir=False yield to an Dag ImportError because of unknown Keyword Argument mount_tmp_dir. Raise cls(e, response=response, explanation=explanation)ĭ: 400 Client Error for http+docker://localhost/v1.41/containers/create: Bad Request ("invalid mount config for type "bind": bind source path does not exist: /tmp/airflowtmp037k87u6") Raise create_api_error_from_http_exception(e)įile "/home/airflow/.local/lib/python3.6/site-packages/docker/errors.py", line 31, in create_api_error_from_http_exception Return self.create_container_from_config(config, name)įile "/home/airflow/.local/lib/python3.6/site-packages/docker/api/container.py", line 441, in create_container_from_configįile "/home/airflow/.local/lib/python3.6/site-packages/docker/api/client.py", line 274, in _resultįile "/home/airflow/.local/lib/python3.6/site-packages/docker/api/client.py", line 270, in _raise_for_status Result = task_copy.execute(context=context)įile "/home/airflow/.local/lib/python3.6/site-packages/airflow/providers/docker/operators/docker.py", line 319, in executeįile "/home/airflow/.local/lib/python3.6/site-packages/airflow/providers/docker/operators/docker.py", line 258, in _run_imageįile "/home/airflow/.local/lib/python3.6/site-packages/docker/api/container.py", line 430, in create_container Result = self._execute_task(context, task_copy)įile "/home/airflow/.local/lib/python3.6/site-packages/airflow/models/taskinstance.py", line 1361, in _execute_task Self._prepare_and_execute_task_with_callbacks(context, task)įile "/home/airflow/.local/lib/python3.6/site-packages/airflow/models/taskinstance.py", line 1331, in _prepare_and_execute_task_with_callbacks : 400 Client Error: Bad Request for url: http+docker://localhost/v1.41/containers/createĭuring handling of the above exception, another exception occurred:įile "/home/airflow/.local/lib/python3.6/site-packages/airflow/models/taskinstance.py", line 1157, in _run_raw_task Raise HTTPError(http_error_msg, response=self) " ERROR - Task failed with exceptionįile "/home/airflow/.local/lib/python3.6/site-packages/docker/api/client.py", line 268, in _raise_for_statusįile "/home/airflow/.local/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status Mount(source='/home/dlassahn/projects/forecast-system/meteoIntelligence-satellite',Ĭommand="python3 src/scripts.py download_satellite_images " Mounts=[Mount(source='/home/archive_1/archive/satellite_data', My dag is configured as followed: """ this is an example dag """įrom _operator import DockerOperator I had to add - /var/run/docker.sock:/var/run/docker.sock as an additional volume to run docker inside of docker. I have followed the instructions here Airflow init.Īnd the docker-compose.yaml is based on the default one docker-compose.yaml. I am trying to run a simple python script within a docker run command scheduled with Airflow. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |