לוח משרות דרושים איש ביג דאטה Big Data

As part of Lite Interfaces team, youll be part in creating and improving products used by more than 1 billion users around the world, as well as driving growth for Metas family of apps through platforms such as SEO and paid marketing.

Our data engineers work cross-functionally with software engineering, data science and product management to provide the team with essential data needed for making strategic decisions, finding opportunities and answering crucial questions about our users and products.

As a data engineer, you'll have the opportunity to work with petabyte scale datasets and complex data models and logics, which youll then translate into efficient and scalable pipelines, tables and dashboards.
Data Engineer, Lite-Interfaces Responsibilities
Collaborate with engineers, product managers, and data scientists to understand data needs, representing key data insights in a meaningful way
Design, build, and launch collections of sophisticated data models and visualizations that support multiple use cases across different products or domains
Solve challenging data integration problems, utilizing optimal ETL patterns, frameworks, query techniques, sourcing from structured and unstructured data sources
Determine and implement the security model based on privacy requirements, confirm safeguards are followed, address data quality issues, and evolve governance processes within allocated areas of ownership
Optimize logging, pipelines, dashboards, frameworks, and systems to facilitate easier development of data artifacts
Influence product and cross-functional teams to identify data opportunities to drive impact

Similarweb is the leading digital intelligence platform used by over 3500 global customers. Our wide range of solutions power the digital strategies of companies like Google, eBay, and Adidas.

We help our customers succeed in todays digital world by giving them access to data-driven insights, competitive benchmarks, strategic analysis, and more.

In 2021, we went public on the New York Stock Exchange, and we havent stopped growing since!


Were looking for a Big Data for Shopper Group, to develop and integrate systems that retrieve, process and analyze data from around the digital world, generating customer-facing data.

Why is this role so important at Similarweb?

Similarweb is a data-focused company, and data is the heart of our business.

As a data engineer, you will work at the very core of the shopper solution, designing and implementing complex high scale systems to retrieve and analyze data from millions of digital users.

Your role as a data engineer will give you the opportunity to use the most cutting-edge technologies to solve complex technical problems.



So, what will you be doing all day?

Your role as part of the R&D team means your daily responsibilities may include:

You will work in a heterogeneous team alongside data scientists. Together you will tackle complex data challenges and bring new solutions and algorithms to production.
Develop and maintain data processing jobs using big data technologies
Contribute and improve the existing infrastructure of code and data pipelines, constantly exploring new technologies.
You will experiment with various technologies in the domain of big data processing.
You will monitor our data pipelines to ensure data is ingested correctly from various sources, you will identify and fix bottlenecks and failures.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

At Similarweb, we are revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online.

Our unique data and solutions empower over 4,300 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies. In 2021, we went public on the New York Stock Exchange and continue reaching new heights! Come work alongside Similarwebbers who are bright, curious, practical, and good people.

Were looking for a DATA -BACKEND (DATA EXTRACTION) to take an important part in SimilarWebs data extraction team and play a key role in our growing data acquisition operation.

This role will report to the Team manager- R&D.

Why is this role so important at Similarweb?

Similarweb is a data-focused company, and data is the heart of our business. As a data server engineer, you will work in one of the companys core teams and design and implement complex, high-scale systems that retrieve and analyze data from around the internet.

You will be responsible for:

Scraping - Building and maintaining high scale web-scraping operations.
Processing - Creating complex data pipelines that process and enrich our raw data and serve it to different consumers through various databases and data-lakes.
Engineering - Designing and building large scale, high quality systems to support our data infrastructure and production systems
As a Data-Server Engineer in Data Extraction, you will:

Write complex PySpark applications that process, manipulate and validate large datasets, in high quality and under strict SLA.
Develop dockerized high-performance microservices.
Take a major part in designing and implementing complex high scale systems using a large variety of technologies.
Work in a team with talented and independent engineers with whom youll be able to share knowledge and expertise.
learn new technologies, handle a multitude of systems.
Implement solutions in AWS cloud environment.
Take part in monitoring and debugging data pipelines and high scale services in order to identify and fix bottlenecks and failures.