VMware Senior Data Engineer - Opportunity for Working Remotely in Boston, Massachusetts
The Security Analytics Engineering group is looking to hire a Senior Data Engineer who loves working on complex problems and getting things done. The teams focuses on using analytics, machine learning, and threat research on petabyte-scale data to deliver security value to millions of business users across thousands of businesses.
The product portfolio is a part of the rapidly growing Carbon Black Cloud platform that delivers next-generation endpoint protection capabilities from the cloud. Now with the full resources of VMware, you have the opportunity to make an impact and build upon Carbon Black’s success.
Design, implement, and maintain end-to-end data pipelines with an understanding of ML lifecycles
Drive development of data products in collaboration with data scientists and machine learning engineers.
Build and scale data platform infrastructure that powers analytics both batch and real-time.
Responsible for overall system architecture, scalability, reliability, and performance of one or more data pipelines and data platform components.
Provide Architecture guidance and work closely to uplevel the engineering organization.
What you bring:
6-8 plus years of experience in relevant areas in building large scale, distributed systems
Experience in big data technologies. (Spark, Flink, MapReduce, HDFS, Hive, Presto, Avro, Parquet, Airflow, etc)
Experience in large scale messaging system (Kinesis/Kafka)
Experience in the public cloud (e.g. S3, RDS, Athena, VPCs, etc)
Practical experience in building solid, distributed, internet-scale enterprise-class solutions/services in Java/Python
Experience with big data design, ETL, technology, efficient designs for distributed systems, and big data environments.
Experience in building data platform infrastructure, tooling, and automation
Experience in the Security domain
Category : Engineering and Technology
Subcategory: Software Engineering
Experience: Manager and Professional
Full Time/ Part Time: Full Time
Posted Date: 2021-02-10
VMware Company Overview: At VMware, we believe that software has the power to unlock new opportunities for people and our planet. We look beyond the barriers of compromise to engineer new ways to make technologies work together seamlessly. Our cloud, mobility, and security software form a flexible, consistent digital foundation for securely delivering the apps, services and experiences that are transforming business innovation around the globe. At the core of what we do are our people who deeply value execution, passion, integrity, customers, and community. Shape what’s possible today at http://careers.vmware.com.
Equal Employment Opportunity Statement: VMware is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: VMware is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at VMware are based on business needs, job requirements and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. VMware will not tolerate discrimination or harassment based on any of these characteristics. VMware encourages applicants of all ages. Vmware will provide reasonable accommodation to employees who have protected disabilities consistent with local law.