Data Engineer ( Pyspark + Databricks are Must)
Job Description:
Senior Data Engineer, Platform
Contractor (through Deel)
English: C1
Locations: Remote ยท Argentina, Uruguay, Mexico
Data is the foundation of our technology. Our team is responsible for evaluating, accelerating, building, and maintaining a unified, scalable and cost-effective analytics infrastructure, including the data lake, a data warehouse, and the tooling for data job scheduling and orchestration.
As a Data Engineer, you will build, optimize and maintain data pipelines using distributed computing on the Cloud. The ideal candidate is an experienced data wrangler who can understand and optimize data systems from the ground up. You will support our software developers, data analysts and data scientists on data initiatives, and ensure an optimal data delivery architecture that stays consistent across ongoing projects. You are self-directed and comfortable supporting the data needs of multiple teams, systems and products.
Responsibilities
Develop and operationalize scalable and reliable data pipelines.
Assemble large, complex data sets that meet functional and non-functional business requirements.
Apply database management techniques including logical data modeling, physical database optimization and security.
Improve the integrity of data pipelines by setting up data quality checks to provide a comprehensive data service.
Work with Data and Analytics experts to strive for greater functionality in our data systems.
Provide on-call support and unblock users based on the severity of the issue.
Qualifications
6+ years of experience engineering and operationalizing data pipelines with large and complex datasets.
6+ years working with unstructured data (JSON).
Extensive experience in Advanced SQL.
6+ years in Python / PySpark.
6+ years transforming data using Databricks.
6+ years with AWS.
Experience with Git (CI/CD).
Power BI or a similar visualization tool.
What we offer
100% remote work (flexible around US time zones).
USD fixed monthly compensation (through Deel).
Paid local national holidays.
Autonomy in managing your deliverables and time off.
Mac equipment provided.