At Similarweb, we are revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online.
Our unique data and solutions empower over 4,300 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies.
In 2021, we went public on the New York Stock Exchange, and we continue to reach new heights! Come work alongside Similarwebbers across the globe who are bright, curious, practical and good people.
Were looking for a Senior Big Data Engineer in the Data Collection Ingest team to contribute to the design and coding of Similarwebs data ingestion services. This role involves working as part of a team that handles millions of requests per minute across hundreds of servers, processing billions of events each day.
This role will report to the R&D Director of Data Collection.
Why is this role so important at Similarweb?
As the most trusted platform for measuring online behavior, millions of people rely on Similarwebs insights daily as the ground truth for their knowledge of the digital world. Producing these insights requires large scale raw data to be ingested reliably in high scale to provide stable signals for analysis.
As a Data/Server Developer you will have the opportunity to perform hands-on work and own Similarwebs raw data ingestion pipeline end-to-end. Your work will have a direct impact on the quality and reliability of our data and the insights that our products are delivering to our customers.
So, what will you be doing all day?
Your role as Data/Server Developer of the Ingest Data Collection team means your daily responsibilities may include:
Design, code and manage end-to-end Similarwebs data ingestion pipelines, both online and offline.
Run the production environment by monitoring availability and taking a holistic view of system health and data quality.
Own data infrastructure features from design to production using industry best practices with focus on quality and delivery.
Lead designs & decision-making processes of the team.
Solve diverse complex problems of scale, performance and business logic.
Collaborate with product managers and other team leaders to plan, nurture, and implement an efficient and effective development process.
Continuously learn and evaluate new technologies in the everlasting effort to perfect our products
Perform code reviews, evaluate implementations, and provide feedback about potential improvements.
Improve your skills, learn from and mentor top-notch engineers and enrich other team members.
Have lots of fun!
Requirements: This is the perfect job for someone who:
5+ years of experience in developing code for big data infrastructure. Actual hands-on programming experience using Scala/Java
2+ years of experience in server-side development with at least one of the languages NodeJs/Python
Experience with Big Data technologies and common frameworks - Spark - must!
another technologies such as Airflow, Kafka, Parquet, Databricks, EMR, Kubernetes - big advantage.
Proven experience working with high scale on AWS or any other cloud provider. Experience in architecture and design of large-scale and high performance web production systems.
Bsc. in computer science or equivalent experience.
Comfortable taking challenges and learning new technologies.
Excellent communication skills with the ability to provide constant dialog between teams.
Ability to take business requirements and translate them to technical alternatives by performing risk management and evaluating tradeoffs.
.המשרה מיועדת לנשים ולגברים כאחד