תיאור תפקיד:
Senior Data Engineer At least 3 years of demonstrated experience in software development.
At least 4 years of experience in building data stream pipelines and ETL using Big Data frameworks such as Spark, Apache Airflow, and BigQuery.
Advanced proficiency in Python and SQL.
Extensive experience with various types of databases.
Skilled in using Python data analysis libraries (e.g., Pandas, Numpy, Arrow).
Proven experience in deploying pipelines on the cloud (GCP preferred), including testing, staging, and monitoring.
Proficient in applying software engineering best practices, including coding standards, code reviews, - CI/CD, and testing
B.Sc in Computer Science or a related scientific field.
תפקיד של איש דאטה יחיד בחברה בתוך קבוצת תוכנה ******** Data Engineer Tech Lead BSc/BA in Computer Science or similar.
At least 6 years proven experience as a Big Data Engineer.
At least 3 years of experience with Python.
Experience with both SQL and NoSQL databases, including Elastic Search, Splunk, MongoDB.
Experience with AirFlow.
Experience with Nifi.
Experience with processing of large data sets.
Experience with Linux environment.
Experience with software design and development in a test-driven environment.
דרישות:
Data Engineer Team Lead 3+ years of experience in leading people
3+ years of experience in data engineering
5+ years of experience as a software developer (Python preferred)
Proficient in the composition of Advanced SQL (analytical functions) and query performance tuning skills
Experience working within the AWS ecosystem (AWS S3, Glue, EMR, Redshift, Athena) or comparable cloud environments (Azure/GCP)
Experience extracting, ingesting, and transforming large data sets
Experience with working with multiple kinds of databases (relational, document storage, key-value, time-series) and their associated query languages - specifically understanding when to use one vs. another
Experience with big data platforms such as Spark, Databricks, and Kafka as a streaming bus
Experience utilizing enterprise data warehousing systems such as Redshift or Snowflake
AI-savvy: comfortable working with AI tools and staying ahead of emerging trends.
היקף משרה:
משרה מלאה
קוד משרה:
JB-00562
אזור:
מרכז - תל אביב, פתח תקווה, רמת גן וגבעתיים, בקעת אונו וגבעת שמואל, חולון ובת-ים, מודיעין
שרון - חדרה וזכרון יעקב, נתניה ועמק חפר, רעננה, כפר סבא והוד השרון, ראש העין, הרצליה ורמת השרון
ירושלים - ירושלים, יהודה ושומרון, בית שמש
צפון - גליל, טבריה והכנרת, עפולה, נצרת ובית שאן, עכו, נהריה והגליל המערבי, קריות ועמק זבולון, חיפה והכרמל, גולן
דרום - אשדוד, קרית גת, באר שבע, דימונה, אשקלון, קרית מלאכי, ערד וים המלח
השפלה - ראשון לציון ונס- ציונה, רמלה לוד, רחובות, יבנה
|