Senior Data Engineer
Kiddom
Data Science
San Francisco, CA, USA
Posted 6+ months ago
About Kiddom
Kiddom is a groundbreaking educational platform that promotes student equity and growth by uniting high-quality instructional materials with dynamic digital learning. Through unparalleled curriculum management functionality, Kiddom empowers schools and districts to take ownership of their curriculum – resulting in learning experiences tailored to meet the unique needs and goals of local communities. Kiddom’s high-quality curriculum is layered with robust teacher and leader data insights to drive the continuous improvement of instructional decisions, school/district programming, and professional learning.
The Data Architecture team builds and supports Kiddom’s data systems. In addition to improving the core architecture of our curriculum graphs and analytics, they also support other teams in the company and their usage of the Kiddom data platform, with an eye for student data privacy and security.
You will work closely with other departments, including Product, Engineering, and Analytics, to understand and cater to their data needs. You will also define and document data workflows, pipelines, and transformation processes for clear understanding and knowledge sharing.
We are looking for someone with excellent communication skills, with the ability to articulate complex technical concepts to non-technical stakeholdersDo you have a strong understanding of PII compliance and best practices in data handling and storage. If you also exhibit strong problem-solving skills, with a knack for optimizing performance and ensuring data integrity and accuracy, we want to chat!
You will...
- Design, build, and maintain scalable data pipelines to transform raw data into analytics-ready datasets.
- Ensure optimal performance, reliability, and efficiency of the data pipelines.
- Monitor and Deploy the data infrastructure for performance bottlenecks and implement optimizations as necessary.
- Collaborate with other engineering teams to ensure seamless data integration with high availability.
- Leverage SQL, DBT, Golang, Python, Terraform and AWS tools to enhance our data infrastructure.
- Keep the Kiddom team updated on the latest advancements in AI and data engineering tools and best practices.
What we're looking for...
- Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.
- 3+ years of experience as a data engineer, and 8+ years of software engineering experience (including data engineering)
- Expertise with RDMS and Data Warehousing, demonstrating ability to design and optimize data pipelines, systems and architectures.
- Experience in managed services for data ingestion/processing with hands-on experience working in AWS environments and operational experience with deploying infrastructure on AWS using Terraform.
- Expert-level knowledge of SQL and a solid understanding of NoSQL & graph databases (e.g., Cassandra, Neptune).
- Experience with distributed compute platforms and frameworks, such as Kubernetes/ECS, AWS Lambdas, Spark and distributed storage systems.
- Expertise with any of data orchestration platforms such as Airflow, Dagster, Prefect or similar frameworks.
Salary range is dependent on geographic location, prior experience, seniority, and demonstrated role related ability during the interview process.
What we offer
Full time permanent employees are eligible for the following benefits from their first day of employment:
* Competitive salary
* Meaningful equity
* Health insurance benefits: medical (various PPO/HMO/HSA plans), dental, vision, disability and life insurance
* One Medical membership (in participating locations)
* Flexible vacation time policy (subject to internal approval). Average use 4 weeks off per year.
* 10 paid sick days per year (pro rated depending on start date)
* Paid holidays
* Paid bereavement leave
* Paid family leave after birth/adoption. Minimum of 16 paid weeks for birthing parents, 10 weeks for caretaker parents. Meant to supplement benefits offered by State.
* Commuter and FSA plans
Equal Employment Opportunity Policy
Kiddom is committed to providing equal employment opportunities to all employees and applicants without regard to race, religion, color, gender, sexual orientation, transgender status, national origin, citizenship status, uniform service member status, pregnancy, age, genetic information, disability, or any other protected status in accordance with all applicable federal, state, and local laws.