לוח משרות דרושים Senior BigData Developer

At Similarweb, we are revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online.

Our unique data and solutions empower over 4,300 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies.

In 2021, we went public on the New York Stock Exchange, and we continue to reach new heights! Come work alongside Similarwebbers across the globe who are bright, curious, practical and good people.



Were looking for a Senior Big Data Engineer in the Data Collection Ingest team to contribute to the design and coding of Similarwebs data ingestion services. This role involves working as part of a team that handles millions of requests per minute across hundreds of servers, processing billions of events each day.

This role will report to the R&D Director of Data Collection.

Why is this role so important at Similarweb?

As the most trusted platform for measuring online behavior, millions of people rely on Similarwebs insights daily as the ground truth for their knowledge of the digital world. Producing these insights requires large scale raw data to be ingested reliably in high scale to provide stable signals for analysis.

As a Data/Server Developer you will have the opportunity to perform hands-on work and own Similarwebs raw data ingestion pipeline end-to-end. Your work will have a direct impact on the quality and reliability of our data and the insights that our products are delivering to our customers.

So, what will you be doing all day?

Your role as Data/Server Developer of the Ingest Data Collection team means your daily responsibilities may include:

Design, code and manage end-to-end Similarwebs data ingestion pipelines, both online and offline.
Run the production environment by monitoring availability and taking a holistic view of system health and data quality.
Own data infrastructure features from design to production using industry best practices with focus on quality and delivery.
Lead designs & decision-making processes of the team.
Solve diverse complex problems of scale, performance and business logic.
Collaborate with product managers and other team leaders to plan, nurture, and implement an efficient and effective development process.
Continuously learn and evaluate new technologies in the everlasting effort to perfect our products
Perform code reviews, evaluate implementations, and provide feedback about potential improvements.
Improve your skills, learn from and mentor top-notch engineers and enrich other team members.
Have lots of fun!

Similarweb is a leading digital intelligence platform, empowering over 4300 global customers with data-driven insights, competitive benchmarks, and strategic analysis. Since going public on the NYSE in 2021, Similarweb continues to innovate and expand, supporting companies like Google, eBay, and Adidas in their digital strategies.

We are seeking a skilled Senior Data/ Backend Engineer to design and implement complex, high-scale systems that retrieve, process, and analyze data from the digital world. This role involves developing and maintaining backend infrastructure, creating robust data pipelines, and ensuring the seamless operation of data-driven products and services.


Key Responsibilities:

- Design and build high-scale systems and services to support data infrastructure and production systems.

- Develop and maintain data processing pipelines using technologies such as PySpark, Hadoop, and Databricks.

- Implement dockerized high-performance microservices and manage their deployment.

- Monitor and debug backend systems and data pipelines to identify and resolve bottlenecks and failures.

- Work collaboratively with data scientists, analysts, and other engineers to develop and maintain data-driven solutions.

- Ensure data is ingested correctly from various sources and is processed efficiently.

Similarweb is a leading digital intelligence platform, empowering over 4300 global customers with data-driven insights, competitive benchmarks, and strategic analysis. Since going public on the NYSE in 2021, Similarweb continues to innovate and expand, supporting companies like Google, eBay, and Adidas in their digital strategies.

We are seeking a skilled Senior Data/ Backend Engineer to design and implement complex, high-scale systems that retrieve, process, and analyze data from the digital world. This role involves developing and maintaining backend infrastructure, creating robust data pipelines, and ensuring the seamless operation of data-driven products and services.



Key Responsibilities:

- Design and build high-scale systems and services to support data infrastructure and production systems.

- Develop and maintain data processing pipelines using technologies such as PySpark, Hadoop, and Databricks.

- Implement dockerized high-performance microservices and manage their deployment.

- Monitor and debug backend systems and data pipelines to identify and resolve bottlenecks and failures.

- Work collaboratively with data scientists, analysts, and other engineers to develop and maintain data-driven solutions.

- Ensure data is ingested correctly from various sources and is processed efficiently.

ecurity represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsofts mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world.

Microsoft, as a leader in the cyber security domain, has a rich portfolio of security products. To protect our customers, we must keep finding creative, scalable and high-end methods to detect malicious activities and to provide our customers with out-of-the-box personalized protection. This is where our team comes into the picture! Our responsibility is to protect Microsoft Security customers, focusing on Microsoft Defender for Cloud and Microsoft Security Exposure Management customers. To accomplish this, we are looking for a problem solver passionate about data, data science, and AI to join us on our journey.
Responsibilities
As a data scientist on our team, you will work closely with security experts, software developers, and product managers to tackle many different types of problems. You will utilize generative AI tools, supervised and unsupervised learning methods, statistical methods, anomaly detection techniques, graph algorithms and more, to help customers protect their environment and to identify malicious activities. You will be independent but surrounded by a large team of strong and experienced data scientists and security researchers, who will help you to develop your skills and advance your career. We believe in ownership. As part of our team, you will be responsible for the entire project life cycle. Starting from coming up with an idea, to business and data understanding, performing the research work, collaborating with software developers, product managers and other researchers, and up to developing the production code of your components. We also love to share ideas and inspire one another.