Senior Data Engineer
Kiddom
Data Science
San Francisco, CA, USA
Posted 6+ months ago
About Kiddom
Kiddom is a groundbreaking educational platform that promotes student equity and growth by uniting high-quality instructional materials with dynamic digital learning. Through unparalleled curriculum management functionality, Kiddom empowers schools and districts to take ownership of their curriculum – resulting in learning experiences tailored to meet the unique needs and goals of local communities. Kiddom’s high-quality curriculum is layered with robust teacher and leader data insights to drive the continuous improvement of instructional decisions, school/district programming, and professional learning.
The Data Architecture team builds and supports Kiddom’s data systems. In addition to improving the core architecture of our curriculum graphs and analytics, they also support other teams in the company and their usage of the Kiddom data platform, with an eye for student data privacy and security.
You will work closely with other departments, including Product, Engineering, and Analytics, to understand and cater to their data needs. You will also define and document data workflows, pipelines, and transformation processes for clear understanding and knowledge sharing.
We are looking for someone with excellent communication skills, with the ability to articulate complex technical concepts to non-technical stakeholdersDo you have a strong understanding of PII compliance and best practices in data handling and storage. If you also exhibit strong problem-solving skills, with a knack for optimizing performance and ensuring data integrity and accuracy, we want to chat!
You will...
- Design, build, and maintain scalable data pipelines to transform raw data into analytics-ready datasets.
- Ensure optimal performance, reliability, and efficiency of the data pipelines.
- Monitor and Deploy the data infrastructure for performance bottlenecks and implement optimizations as necessary.
- Collaborate with other engineering teams to ensure seamless data integration with high availability.
- Leverage SQL, DBT, Golang, Python, Terraform and AWS tools to enhance our data infrastructure.
- Keep the Kiddom team updated on the latest advancements in AI and data engineering tools and best practices.
What we're looking for...
- Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.
- 3+ years of experience as a data engineer, and 8+ years of software engineering experience (including data engineering)
- Expertise with RDMS and Data Warehousing, demonstrating ability to design and optimize data pipelines, systems and architectures.
- Experience in managed services for data ingestion/processing with hands-on experience working in AWS environments and operational experience with deploying infrastructure on AWS using Terraform.
- Expert-level knowledge of SQL and a solid understanding of NoSQL & graph databases (e.g., Cassandra, Neptune).
- Experience with distributed compute platforms and frameworks, such as Kubernetes/ECS, AWS Lambdas, Spark and distributed storage systems.
- Expertise with any of data orchestration platforms such as Airflow, Dagster, Prefect or similar frameworks.
Salary range is dependent on geography, past experience, seniority, and demonstrated role related ability during the interview process.
What we offer
Full time permanent employees are eligible for the following benefits:
-Competitive salary
-Meaningful equity
-Health benefits: medical (various PPO/HMO/HSA plans), dental, vision, disability and life insurance
-10 paid sick days per year
-Unlimited vacation time policy (subject to internal approval). Average use 4 weeks off per year.
-Paid family leave for eligible employees
COVID Vaccination Policy
Kiddom policy requires employees to be vaccinated before they visit an office or attend company events..
We have remote roles but in certain positions where office attendance is deemed to be essential to the role, offers of employment shall be conditional upon proof of vaccination.