As a Senior Data Engineer at MSTICRnD, you will play a pivotal role in managing and executing big data solutions and pipelines for our security data-driven products. Your work will ensure a seamless flow of information throughout the company, balancing backend data structure with frontend accessibility for end-users. You will collaborate closely with engineers, product managers, and security analysts to understand data needs, ensure data availability, and represent key data insights visually in meaningful ways. Your responsibilities will also include ownership of data privacy, security, compliance, and quality.
Why Join Us?
Impact: Make a significant impact by contributing to the protection of Microsoft and its customers.
Growth: Grow and develop your skills in a fascinating domain.
Environment: Work in a live, fast-paced environment with opportunities to learn and influence.
If you are passionate about delivering next-gen security services and excited about working in a dynamic and innovative environment, we invite you to join us for a great ride!
Microsofts mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.
Responsibilities
ETL Pipelines: building and managing ETL (Extract, Transform, Load) pipelines.
Big Data Solutions: Design, implement, and manage big data pipelines to support security data-driven products.
Collaboration: Work with engineers, product managers, and security analysts to understand and address data needs.
Data Availability: Ensure the availability and accessibility of data across the organization.
Monitoring and Alerts: create monitoring and alert systems to ensure data integrity and system performance.
Data Visualization: Represent key data insights visually to provide meaningful information to end-users.
Data Privacy and Security: Maintain ownership of data privacy, security, compliance, and quality.
Requirements: 7+ years of experience, with a proven track record of leading complex development efforts and delivering impactful solutions.
M.Sc. or Ph.D. in Computer Science, Computer Engineering, or a related field.
Proven experience as a DBA or Data Engineer.
Experience in building and managing ETL (Extract, Transform, Load) pipelines.
Expertise in database design, documentation, and coding; SQL (or similar) query optimizations; big data and data pipelines; familiarity with programming languages.
Ability to lead complex development efforts and make impactful contributions.
A strong passion for software development, security, and cloud technologies.
Desire to work with highly skilled and fun team members in a dynamic and growing product development environment.
Preferred Qualifications:
Experience with cloud platforms such as Azure, AWS, or Google Cloud.
Proficiency with big data technologies such as Hadoop, Spark, Kafka, or similar.
Experience with data warehousing solutions like Snowflake, Redshift, or BigQuery.
Proficiency with data visualization tools such as Power BI, Tableau, or similar.
Strong programming skills in languages such as Python, Java, or Scala.
Experience with DevOps practices and tools, including CI/CD pipelines.
Excellent problem-solving skills, strong communication abilities, and a collaborative mindset.
Relevant certifications in data engineering, cloud technologies, or cybersecurity.
.המשרה מיועדת לנשים ולגברים כאחד