Job Description
Responsibilities :
1. Work in big data. Take existing solutions, optimize and build high-performance algorithms. Scale algorithms on terabytes of data. Improve time complexity and space complexity of data pre-processing. Recommend ways to improve data reliability, efficiency and quality.
2. Process structured and unstructured data, validate data quality, help to design data quality tests in big data environment.
3. Help to develop and support data products. Develop data set processes for data modeling, mining and production.
4. Work closely with engineers and data scientists. Help data science team and engineers to improve spark performance. Be involved into data products deployment.
5. Create custom software components using Spark or PySpark (e.g. specialized UDFs) and analytics applications.
6. Help to create visualization tools for tracking model performance and data quality. Integrate new data management technologies and software engineering tools into existing structures.
7. Collaborate with data architects, engineers, data scientist, business team members on project goals.
Minimum qualifications:
- BS degree in a quantitative field such as statistics, operations research, computer science, mathematics, physics, electrical engineering, industrial engineering.
-2 years of relevant work experience in big data analysis or related field (data engineer/developer).
-Expert in Spark, Python/ or R, PySpark/ or SparkR, Scala, SQL/Hive
- Familiar with Spark MLlib, SparkSQL
-Accomplished in Hadoop-based data mining frameworks.
Preferred qualifications:
- MS or PhD degree in a quantitative field.
- 2-3 years of relevant work experience, including deep expertise in Spark.
Description Psychology teacher urgently needed for an outstanding bilingual school in Shanghai - Position to start in August 2019! Newly qualified teacher are welcome to apply.Our client is urgently seeking an experienced and flexible...
Job Description Access Healthcare is seeking a travel CT Technologist for a travel job in Pittsburgh, Pennsylvania. Job Description & Requirements ~ Specialty: CT Technologist ~ Discipline: Allied Health Professional ~ Start Date: ASAP ~ Duration: 12 weeks...
...passionate about creating technology that truly works, and we welcome developers who want to grow, contribute ideas, and help scale an... ...person. Additional Details Work Location: Warrington, PA (no remote opportunities at this time) Schedule: MondayFriday Dress...
...everything we do. With operations spanning 40+ countries, as we continue expanding globally, ensuring smooth, compliant, and high-quality relocation experiences is critical to enabling talent mobility. The Global Mobility pillar within our Global Mobility & Immigration (GMI)...
Sephora seeks a Social Impact Manager in San Francisco to lead community engagement initiatives. This role involves managing employee programs, coordinating strategic partnerships, and enhancing Sephora's social impact through innovative campaigns. The position offers a...