As a member of our team, you will join us in architecting the future of data and machine learning platforms. You will drive and deliver the ongoing vision for big data warehouse and data governance initiatives. You will help evolve and innovate our infrastructure to service
About the Team
We process billions of events spread over 200 connected device types to enable our stakeholders to make business decisions efficiently and with ease. Central to the team is building a big data warehouse that could abstract the details of managing large datasets in a big data environment. Our data warehouse, based on S3 and Redshift, has petabytes of data and forms the base of many data products.
What You’ll Do
- Implement high-performance, elastically scalable, data warehousing technologies to power content & user insights, quality monitoring, and experimentation.
- Maintain and rethink existing datasets and pipelines to service a wider variety of use cases.
- Collaborate with stakeholders to enable efficient data warehouse usage for their use cases and needs
Key attributes we would like you to have:
- Expert in engineering modern warehouse technologies and processes ( Redshift, Snowflake, Netezza, Teradata, BigQuery, Presto, etc..) on large scale data set demonstrated through 5+ years of experience
- Familiarity with other big data technologies (Hive, HBase, Spark, Flink, etc)
- Highly proficient in at least one of Java, Python, or Scala
- Comfortable with complex SQL
- Understand the Data Lifecycle and concepts such as lineage, governance, privacy,
retention, anonymity, etc - Conceptually familiar with AWS cloud resources (S3, EC2, RDS, etc)
- Experience with modern deployment and CI/CD practices (Docker, Kubernetes, and
Spinnaker) - Hungry for impact and insatiably curious about new technologies and frameworks.
- Ready to build new things without being constrained by technical debt, in a nimble, startup-like environment.
About benefits and bonuses
• Medical insurance, or money to pay your own ($100/month)
• $50 gym allowance
• $25 internet allowance
• $500/year for education
• Equipment (laptop)
• Maternity/Paternity/peternity paid leave