Login for faster access to the best deals. Click here if you don't have an account.

Data Engineer وقت كامل وظيفة

منذ سنتين تكنولوجيا المعلومات والاتصالات Beirut   1.4K الآراء
تفاصيل الوظيفة

Do you have a passion for data, analytics, insights andtechnology?  AI Venture Labsis looking for a talented Data Engineer who wants to get their hands onlarge and complex datasets and databases, with deep knowledge of SQL database design,distributed systems and computer science, who’s interested in working alongsidedata scientists to build and deploy cutting-edge analytical capabilities anddrive business impact.

 

Responsibilities:

·        Develop andmaintain data pipelines including solutions for data collection, management andusage.

·        Work closelywith Data Scientists to optimize and reengineer model code to be modular,efficient and scalable, and to deploy models to production.

·        Maintain andenhance data and computation platforms.

·        Develop andimplement solutions for data quality validation and continuous improvement.

·        Manage,execute and monitor weekly and monthly production operations; resolve andescalate production issues as appropriate.

·        Partner withdata scientists, PMs, engineers and business stakeholders to understandbusiness and technical requirements, plan and execute projects, and communicatestatus, risks and issues.

·        Perform rootcause analysis of system and data issues and develop solutions as required.

 

Required Qualifications:

·        BS incomputer science or Information Systems.

·        Proficient inSQL and database architectures.

·        Experienceworking with cloud-based technologies, including relational databases, datawarehouse, big data (e.g., Hadoop, Spark), orchestration/data pipeline tools.

·        Experiencewith Azure Analytics stack, e.g., Azure Data Lake, Azure Databricks, Azure DataFactory.

·        Experiencewith ETL data pipelining concept.

·        Proficient inPower BI.

·        Experienceworking in software engineering, and can demonstrate best practices for projectmanagement, quality control, and product development.

·        Proven trackrecord of collaborative development in an agile team environment.

·        Experiencewith R, Python and libraries for data exploration, modeling and visualization.

 

PreferredQualifications:

·        Machine learningexperience

·        Experiencewith infrastructure automation technologies like Docker and Kubernetes.

·        Experiencebuilding APIs and services using REST.

 

وصف الشركة
We accelerate AI, cloud based startups to transform industries vertical-by-vertical, and we provide them with Industry Labs to build and grow. For that end, we have developed a new co-acceleration approach by partnering with Microsoft to give startups access to vital resources and industry knowledge that otherwise would be out of reach.