DataLink is a new open source solution to bring Flink development to data center.

Overview

DataLink

简介

DataLink 是一个创新的数据中台解决方案,它基于 SpringCloud Alibaba 和 Apache Flink 实现。它使用了时下最具影响力的实时计算框架Flink,而且紧跟社区发展,试图只通过一种计算框架来解决离线与实时的问题,实现Sql语义化的批流一体,帮助用户减少技术与运维成本,推动数据产业更高效的发展。

面对业内数据人员紧缺的现状,DataLink 的目标不仅要实现企业级数据中台的全部功能,而且还要通过设计多种辅助决策功能来缓解人才的需求,助力数据生产。

DataLink 开源项目及社区正在建设,希望本项目可以帮助你更快发展。

功能

正在维护中....

开始

下载安装包

正在维护中...

从源码编译安装包

maven clean install 
bin/ -- 启动脚本
|- auto.sh 
config/ -- 配置文件
|- application.properties
|- application-dev.properties
|- bootstrap.properties
lib/ --外部依赖
|- *.jar
logs/ -- 日志
module/ -- 微服务模块
|- datalink-gateway/ -- 网关模块
|-|- datalink-gateway-0.1-SNAPSHOT.jar
|- datalink-uaa/ -- 授权模块
|-|- datalink-uaa-0.1-SNAPSHOT.jar
|- datalink-user/ -- 用户模块
|-|- datalink-user-0.1-SNAPSHOT.jar

正在维护中...

启动

ln -s /usr/local/datalink/config/ /usr/local/datalink/module/datalink-gateway/
ln -s /usr/local/datalink/config/ /usr/local/datalink/module/datalink-uaa/
ln -s /usr/local/datalink/config/ /usr/local/datalink/module/datalink-user/
sh auto.sh start base

正在维护中...

单机模式

正在维护中...

集群模式

正在维护中...

结构

DataLink -- 父项目
|-datalink-commons -- 通用中心
| |-datalink-auth-spring-boot-starter -- Spring Security 封装模块
| |-datalink-base -- 基础封装模块
| |-datalink-common-spring-boot-starter -- 通用封装模块
| |-datalink-db-plug -- DB工具封装模块
| |-datalink-elasticsearch-spring-boot-starter -- Elasticsearch 封装模块
| |-datalink-log-spring-boot-starter -- Log 封装模块
| |-datalink-mybatis-spring-boot-starter -- MybatisPlus 封装模块
| |-datalink-redis-spring-boot-starter -- Redis 封装模块
| |-datalink-ribbon-spring-boot-starter -- RibbonFeign 封装模块
| |-datalink-sentinel-spring-boot-starter -- Sentinel 封装模块
| |-datalink-swagger-spring-boot-starter -- Swagger 封装模块
|-datalink-config -- 配置中心
|-datalink-dbase -- 基础资源中心
| |-datalink-db -- DB 中心[8003]
| |-datalink-user -- 用户中心[8001]
|-datalink-doc -- 文档中心
|-datalink-gateway -- 网关中心[9900]
|-datalink-uaa -- 权限中心[8002]
|-datalink-web -- React Web [8000]

正在维护中...

交流

欢迎您加入社区交流分享,也欢迎您为社区贡献自己的力量。

QQ社区群:965889874,申请备注 “ 数据中台 ”

公众号:DataLink数据中台

邮箱:[email protected]

友情链接

Apache Flink

Mybatis Plus

microservices-platform

ant-design-pro

本项目的设计思路与代码实现受以上开源项目源码指导与启发,站在巨人的肩膀,才能看得更远。

截图

以下截图为已实现的部分截图,是本开源项目最终效果。

登录页

预览

以下预览图为已实现的部分截图,并非开源项目最终效果,仅供参考。

主页

数据源

元数据

来源构建

FlinkSql

FlinkSql在线开发器

FlinkSql语法校验与执行解释

FlinkSql函数文档

Flink任务历史

Sql翻译

FlinkSql与元数据的血缘分析

NLP字典映射与运维

DB控制台

查询服务注册

共享文件中心

微服务监控

GPE监控

You might also like...

CompreFace is a free and open-source face recognition system from Exadel

 CompreFace is a free and open-source face recognition system from Exadel

CompreFace can be easily integrated into any system without prior machine learning skills. CompreFace provides REST API for face recognition, face verification, face detection, landmark detection, age, and gender recognition and is easily deployed with docker

Dec 31, 2022

An Open Source Java Library for the Rubiks Cube!

An Open Source Java Library for the Rubiks Cube!

📑 Table of contents Overview What is Cubot? Why would you want it? Documentation Installation Updates 📔 Overview A Java library to help you : Virtua

Oct 17, 2022

oj! Algorithms - ojAlgo - is Open Source Java code that has to do with mathematics, linear algebra and optimisation.

oj! Algorithms oj! Algorithms - ojAlgo - is Open Source Java code that has to do with mathematics, linear algebra and optimisation. General informatio

Dec 14, 2022

A open-source addon for Meteor Client.

A open-source addon for Meteor Client.

A open-source addon for Meteor Client

Dec 28, 2022

MathParser - a simple but powerful open-source math tool that parses and evaluates algebraic expressions written in pure java

MathParser - a simple but powerful open-source math tool that parses and evaluates algebraic expressions written in pure java

MathParser is a simple but powerful open-source math tool that parses and evaluates algebraic expressions written in pure java. This projec

Dec 24, 2022

Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.

Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.

What is OpenMetadata? Try our Sandbox Install & Run Documentation and support Contributors License What is OpenMetadata? OpenMetadata is an Open Stand

Dec 31, 2022

Reference implementation for MINAS (MultI-class learNing Algorithm for data Streams), an algorithm to address novelty detection in data streams multi-class problems.

Reference implementation for MINAS (MultI-class learNing Algorithm for data Streams), an algorithm to address novelty detection in data streams multi-class problems.

Sep 7, 2022

Use this to open hidden activities on MIUI.

miui_hidden_libs Use this to open hidden activities on MIUI. Translate for your language: https://drive.google.com/file/d/1---II4WVVvPIn3cPodTC52VPVG3

Nov 10, 2022

Apache Spark - A unified analytics engine for large-scale data processing

Apache Spark Spark is a unified analytics engine for large-scale data processing. It provides high-level APIs in Scala, Java, Python, and R, and an op

Jan 2, 2023
Owner
null
A Slimefun4 addon that adds a new storage solution for mass and organised storage without harsh performance.

Networks is a Slimefun4 addon that brings a simple yet powerful item storage and movement network that works along side cargo. Network Grid / Crafting

null 17 Jan 7, 2023
Datumbox is an open-source Machine Learning framework written in Java which allows the rapid development of Machine Learning and Statistical applications.

Datumbox Machine Learning Framework The Datumbox Machine Learning Framework is an open-source framework written in Java which allows the rapid develop

Vasilis Vryniotis 1.1k Dec 9, 2022
Apache Flink

Apache Flink Apache Flink is an open source stream processing framework with powerful stream- and batch-processing capabilities. Learn more about Flin

The Apache Software Foundation 20.4k Jan 5, 2023
Flink/Spark Connectors for Apache Doris(Incubating)

Apache Doris (incubating) Connectors The repository contains connectors for Apache Doris (incubating) Flink Doris Connector More information about com

The Apache Software Foundation 30 Dec 7, 2022
Data Structures and Algorithms (DSA) - Java Language Using Integrated Development Environments NetBeans

Data Structures and Algorithms (DSA) Course Code : CSC211 Credit Hours : 4 Language : JAVA Integrated development environments : NETBEANS Topic Covere

Ossama Mehmood 샘 2 Oct 1, 2022
A compromise solution to colored lighting in Minecraft by tinting based on area

Colored Lights A compromise solution to colored lighting in Minecraft by tinting based on area. Normally, computing colored lighting would require exc

null 48 Sep 7, 2022
Care aims to create an IoT solution to hospitals interconnecting smart monitors to decrease the time a doctor takes to respond to an emergency.

Care Description This project called Care, developed for the INFO1127 course - Software Engineering - aims to create an IoT solution to hospitals inte

null 5 Oct 4, 2022
Your new way of getting player input. An alternative to the Conversation API

Dialogue Dialogue is a Spigot API that completely revamps the Conversation API. This is not a plugin you put on your server. Want to know what's curre

nthByte 16 Aug 26, 2022
🔍 Open Source Enterprise Cognitive Search Engine

OpenK9 OpenK9 is a new Cognitive Search Engine that allows you to build next generation search experiences. It employs a scalable architecture and mac

SMC 24 Dec 10, 2022