职位详情
Key Responsibilities
Data Architecture Design:
Design scalable and high-performance data architectures leveraging Azure technologies including Databricks, SQL Database, and Azure Data Factory.
Implement Event Hub, Durable Functions, and schema validation mechanisms.
Data Quality and Governance:
Build and deploy data quality and profiling frameworks to manage duplicates, null values, and invalid records.
Maintain adherence to data governance policies, GDPR requirements, and security best practices.
Cloud Integration:
Set up and fine-tune Azure cloud solutions such as Kubernetes, Docker, and virtual machines.
Enable integration of data sources and ensure smooth data ingestion from both internal and external systems.
Required Skills and Competencies
Technical Expertise:
Solid experience with Azure tools like Azure Data Factory, Azure Functions, Databricks, and SQL Database.
Strong command of programming languages including Python and SQL.
Knowledge of Kettle, Airflow DAG
Familiar with Postgresql/polarDB
Exposure to Hadoop/Spark/Flink
Cloud Development:
Proven experience working with cloud environments on Azure and AWS platforms.
Skilled in deploying and managing cloud infrastructure such as Kubernetes and Docker.
Language:
Fluent English communication skills required due to collaboration with team members in UK, India & Germany
Data Architecture Design:
Design scalable and high-performance data architectures leveraging Azure technologies including Databricks, SQL Database, and Azure Data Factory.
Implement Event Hub, Durable Functions, and schema validation mechanisms.
Data Quality and Governance:
Build and deploy data quality and profiling frameworks to manage duplicates, null values, and invalid records.
Maintain adherence to data governance policies, GDPR requirements, and security best practices.
Cloud Integration:
Set up and fine-tune Azure cloud solutions such as Kubernetes, Docker, and virtual machines.
Enable integration of data sources and ensure smooth data ingestion from both internal and external systems.
Required Skills and Competencies
Technical Expertise:
Solid experience with Azure tools like Azure Data Factory, Azure Functions, Databricks, and SQL Database.
Strong command of programming languages including Python and SQL.
Knowledge of Kettle, Airflow DAG
Familiar with Postgresql/polarDB
Exposure to Hadoop/Spark/Flink
Cloud Development:
Proven experience working with cloud environments on Azure and AWS platforms.
Skilled in deploying and managing cloud infrastructure such as Kubernetes and Docker.
Language:
Fluent English communication skills required due to collaboration with team members in UK, India & Germany
2026-06-19 12:56
IP属地:四川成都
职位福利
本科5-10年Azure cloud要求数据开发经验Spark数据平台开发经验数据治理经验金融行业经验Python

艾维登信息科技(北京)有限公司成都分公司
不需要融资 · 500-999人

工作地址

鱼泡安全保障
如遇到办证收费、刷单、传销、诱导买车等违规行为,请立即向鱼泡直聘投诉举报投诉举报 >

附近适合您的职位
大数据开发+福利待遇优厚+双休
1-1.5万元/月
数据开发3-5年本科要求数据开发经验ETL开发经验BI报表开发经验MySQL/SQL Server大型互联网云平台基础服务实时数仓开发经验pysparkpower bi数据仓库开发经验Pythons
成都 武侯区
高级大数据工程师
1.5-2.4万元/月
数据开发3-5年本科非外包类要求数据开发经验ETL开发经验数据建模经验计算机相关专业数据平台开发经验大数据引擎开发经验JavaGoSparkKafkaSpark原理/源码Kafka原理/源码
成都 武侯区









