Data Engineer (PySpark&Airflow)

Remote, Hybrid
- Kraków, Małopolskie, Poland
IT

Job description

We are #VLteam - tech enthusiasts constantly striving for growth. The team is our foundation, that's why we care the most about the friendly atmosphere, a lot of self-development opportunities, and good working conditions. Trust and autonomy are two essential qualities that drive our performance. We simply believe in the idea of “measuring outcomes, not hours”. Join us & see for yourself!

Job requirements

Full job description - Link

Required skills:
Senior: Python

Regular: PySpark

Regular: Airflow

Regular: Docker

Regular: Kubernetes

Regular: xgboost

Regular: Pandas

Regular: Scikit-learn

Regular: Numpy

Regular: GitHub Actions

Regular: Azure DevOps

Regular: Git @ GitHub

What we expect in general?

Hands-on experience with Python.
Proven experience with PySpark.
Proven experience with Data Manipulation libraries (Pandas, NumPy, and Scikit-learn)
Regular-level experience with Apache Airflow.
Strong background in ETL/ELT design.
Regular-level proficiency in Docker and Kubernetes to containerize and scale simulation platform components.
Ability to occasionally visit Krakow office.
Good command of English (B2/C1)

My information

Fill out the information below

Full name

Email address

Phone number

CV or resume

Upload your CV or resume file

Upload a file or drag and drop hereAccepted files: PDF, DOC, DOCX, JPEG and PNG up to 50MB.

Cover letter

Upload your cover letter

Upload a file or drag and drop hereAccepted files: PDF, DOC, DOCX, JPEG and PNG up to 50MB.

Questions

Please fill in additional questions

Are you interested in specific tech stack/domain/project? Let us know!

If you would like to add something?

Legal Agreements

Current recruitment process: For the purpose of recruitment, I hereby give consent as per art. 6.1.a of the GDPR to processing of my personal data (other than that listed in art. 22 [1] § 1 Labour Code) by Virtus Lab Sp. z o. o. (as Co-Controller for a full list of joint controllers, see Privacy Policy) with its headquarters at Szlak 49 Street, 31-153 Cracow. At the same time I accept the Privacy Policy of the Data Controller. I acknowledge that my personal data will be kept for the duration of the recruitment process and as regards any potential claims, for the period of 36 months maximum, and that I have the right to access this data or have it rectified or deleted on demand. This consent can be withdrawn at any time, but this withdrawal does not make the previous processing illegal*.

Future recruitment processes: I hereby give consent as per art. 6.1.a of the GDPR to the processing of my personal data by Virtus Lab Sp. z o. o. (as Co-Controller for a full list of joint controllers, see Privacy Policy) with its headquarters at Szlak 49 Street, 31-153 Cracow, in order to use this data in future recruitment processes. I hereby agree to possible storage of my personal data for this purpose in Virtus Lab’s database for a period of 36 months maximum. At the same time I accept the Privacy Policy of the Data Controller. I acknowledge that I have the right to access this data or have it rectified or deleted on demand. This consent can be withdrawn at any point, but this does not make the previous processing illegal*.

Data Engineer (PySpark&Airflow)

Job description

Job requirements

All done!