People Data Labs · Posted 1d ago
Data Engineer
Job relayed by Stapply Data, its source: you apply there.
- Location
- 🇺🇸 United States
- Contract
- Full-time
- Role
- Data engineering
- Source
- Stapply Data
Stack
The posting
Join our remote-first company as a Data Engineer. You will play a central role in building infrastructure to ingest, transform, and load data from various sources. You will also develop an entity resolution framework, CI/CD pipelines, and solutions to undefined data engineering and data science problems. Enjoy unlimited PTO, monthly employee stipends, and comprehensive medical, dental, and vision insurance.
- Construire une infrastructure pour ingérer, transformer et charger un volume de données en constante augmentation à partir de diverses sources. - Développer un cadre de résolution d'entités organiques capable de fusionner correctement des milliards d'entités individuelles en ensembles de données propres et exploitables. - Développer des pipelines CI/CD et des systèmes de détection d'anomalies pour améliorer continuellement la qualité des données mises en production.
- Experience working with entity data (entity resolution or record linkage) - Ability to balance high ownership and autonomy with strong collaboration - Strong software development fundamentals - Understanding of modern data storage formats and tools, such as Parquet, ORC, Avro, and Delta Lake - Ability to scope and break down projects and communicate progress and blockers effectively with managers, teammates, and stakeholders - Degree in a quantitative discipline such as computer science, mathematics, statistics, or engineering - Ability to work effectively remotely, proactively managing blockers, asking questions, and participating in team activities - 3–5+ years of industry experience, with clear examples of strategic technical problem-solving and implementation - Experience building scalable data processing systems (e.g., cleaning and transformation) from the ground up - Experience writing data design documents, including pipeline design, dataflow, and schema design - Expertise with Apache Spark (Java, Scala, and/or Python-based) - Expertise with Python and the Python data stack, such as NumPy and pandas - Experience using developer-oriented data pipeline and workflow orchestration tools (e.g., Airflow, dbt, Dagster, or similar) - Experience working with data acquisition or data integration - Experience with streaming platforms such as Kafka - Strong written communication skills in Slack/chat and documents - Experience with SQL - Experience with data warehousing, such as Databricks, Snowflake, Redshift, or BigQuery - Experience evaluating data quality and maintaining high data standards across new feature releases, including consistency, accuracy, validity, and completeness - Knowledge of modern data design and storage patterns, such as incremental updating, partitioning and segmentation, rebuilds, and backfills - Experience working in Databricks, including Delta Live Tables and data lakehouse patterns - Experience with Python - Experience with cloud computing services such as AWS, GCP, or Azure