Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.

Last update: Dec 31, 2022

Overview

What is OpenMetadata?
Try our Sandbox
Install & Run
Documentation and support
Contributors
License

What is OpenMetadata?

OpenMetadata is an Open Standard for Metadata. A Single place to Discover, Collaborate, and Get your data right.

OpenMetadata includes the following:

Metadata schemas - defines core abstractions and vocabulary for metadata with schemas for Types, Entities, Relationships between entities. This is the foundation of the Open Metadata Standard.
Metadata store - stores metadata graph that connects data assets, user, and tool generated metadata.
Metadata APIs - for producing and consuming metadata built on schemas for User Interfaces and Integration of tools, systems, and services.
Ingestion framework - a pluggable framework for integrating tools and ingesting metadata to the metadata store. Ingestion framework already supports well know data warehouses - Google BigQuery, Snowflake, Amazon Redshift, and Apache Hive, and databases - MySQL, Postgres, Oracle, and MSSQL.
OpenMetadata User Interface - one single place for users to discover, and collaborate on all data.

Try our Sandbox

Visit our demo at http://sandbox.open-metadata.org

Install and run OpenMetadata

Get up and running in few mins

git clone https://github.com/open-metadata/OpenMetadata
cd OpenMetadata/docker/metadata
docker-compose up -d

Then visit http://localhost:8585

For more details on running OpenMetadata on your local machine or in production, see our Install Doc.

Documentation and Support

Check out OpenMetadata documentation for a complete description of OpenMetadata's features.

Join our Slack Community if you get stuck, want to chat, or are thinking of a new feature.

Or join the group at https://groups.google.com/g/openmetadata-users

We're here to help - and make OpenMetadata even better!

Contributors

We ❤️ all contributions, big and small!

Read Build Code and Run Tests for how to setup your local development environment.

If you want to, you can reach out via Slack or email and we'll set up a pair programming session to get you started.

License

OpenMetadata is released under Apache License, Version 2.0

Comments

Added git action for maven publish
Describe your changes :

Added git action for maven publish

Type of change :

[x] Improvement

[x] New feature

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
opened by parthp2107 77
Selenium tests issue fix
Describe your changes :

I worked on the Fixing selenium issues

Type of change :

[x] Improvement

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have performed a self-review of my own.

[ ] I have tagged my reviewers below.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] My changes generate no new warnings.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers

@darth-coder00 @shahsank3t @parthp2107
opened by kshinde2512 25
Harmonize request titles in json schemas
Describe your changes :

Updated some titles in schema files to generate more consistent type names and classes.

Run prettier on all json schema files

Some minor fixes to enable type generation for rust client.

fix required names in webhook.json

removed filters field from required in rule.json, since hat field has been removed. Should there be another required prop from the new filterRegex etc...

removed all fields from required in databaseConnectionConfig.json since none of the fileds are defined - should there be something now?

closes #1880 - while this issue has since been addressed in other PRs (i.e. using EPOCH for timestamps), this PR addresses some comments in the thread.

Type of change :

[ ] Bug fix

[x] Improvement

[ ] New feature

[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[x] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[x] I have performed a self-review of my own.

[ ] I have tagged my reviewers below.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] My changes generate no new warnings.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers

@sureshms @harshach
opened by roeap 23
Fixes #9259 Change Tags APIs to conform with rest of the APIs
Describe your changes :

See details in #9259

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[x ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

See #9259 for details about backward incompatibility and how to migrate to the new set of tags APIs

Checklist:

[x] I have read the CONTRIBUTING document.

[x] I have commented on my code, particularly in hard-to-understand areas.

[x] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

backend safe to test
opened by sureshms 22
Profiler & Data Quality UI feedback & improvement
[x] When landing on the profiler tab we should be able to add either profiler workflow or test suite workflow (with testCases). Right now to be able to view/add testSuite with testCases we need to first run the profiler -- cc @devyani-kaushik #7114

[x] parameter definition for the custom SQL test is not displayed in an editor but as plain text #7114

[x] the test is available for all column types regardless of type (should replicate the behaviour of 0.11 and filter out certain tests based on column type) it is tracked in #7105

UI
opened by TeddyCr 22
fix 7995: profileSample % and row number
Describe your changes :

fix #7995

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[ ] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
UI Ingestion backend safe to test
opened by ayush-shah 21
UI Improvements 0.13
[x] change "Delete Catagory" button styling to secondary

[x] Left and right padding is not consistent on all pages

[x] Left Column needs to have fixed height

[x] Can we add an empty table when no data is available ?

[x] Delete icon getting cropped in user list

[x] Table styling not consistent

[x] need to update the right documentation link

UI
opened by devyani-kaushik 20
Add Test Suite Implementation for Datalake
Describe your changes :

fix #8514

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[ ] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
Ingestion safe to test
opened by ayush-shah 19
Fix #6141: Ingestion Pipeline Status Updates
Describe your changes :

Fix #6141: Ingestion Pipeline Status Updates

Type of change :

[x] Improvement

[x] New feature

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers

@open-metadata/ingestion
opened by ulixius9 19
Add GET API for allowable operations
[x] Amend PolicyEvaluator to support getAllowedOperations()

[x] Set up REST API for v1/config/permissions

[x] Integrate the above with DefaultAuthorizer

[x] Add unit tests

Describe your changes :

I worked on this to fix #2455

Type of change :

[ ] Bug fix

[x] Improvement

[ ] New feature

[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[ ] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[x] I have performed a self-review of my own.

[x] I have tagged my reviewers below.

[x] I have commented on my code, particularly in hard-to-understand areas.

[x] My changes generate no new warnings.

[x] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers

Backend: @sureshms @harshach @Sachin-chaurasiya
opened by mithmatt 18
Feat: Add freshness + rows inserted graphs on the UI side#9117
Describe your changes :

Add freshness + rows inserted graphs on the UI side#9117 Closes #9117

Type of change :

[x] New feature

Frontend Preview (Screenshots) :

https://user-images.githubusercontent.com/71748675/207606302-c3589aec-0358-4ff9-91d8-472461763cb7.mov

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
UI safe to test
opened by ShaileshParmar11 17
chore(deps): bump luxon from 3.1.0 to 3.2.1 in /openmetadata-ui/src/main/resources/ui
Bumps luxon from 3.1.0 to 3.2.1.

Changelog

Sourced from luxon's changelog.

Changelog

3.2.0 (2022-12-29)

Allow timeZone to be specified as an intl option

Fix for diff's handling of end-of-month when crossing leap years (#1340)

Add Interval.toLocaleString() (#1320)

3.1.1 (2022-11-28)

Add Settings.twoDigitCutoffYear

Commits

b1fee58 bump to 3.2.1

5ab3bf6 fix rfc2822 regex

806467a preserve language tags (#1354)

acc4952 bump dev dependencies

c8f7191 bump to 3.2.0

f9917c4 clarify equality docstring

a6f2737 allow timeZone to be specified as an intl option

f8285c7 find diff by duration hash instead of using repeated addition to cursor (#1340)

d607d8f remove extra param from tokenForPart

7e5d24d Add Interval.toLocaleString() (#1320)

Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

safe to test dependencies javascript
opened by dependabot[bot] 3
UI: Added localization changes part 2
Describe your changes :

Added localization changes part 2

Type of change :

[x] Improvement

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
UI safe to test
opened by ShaileshParmar11 2
IBM DB2 Failure to connect
Affected module Affects Ingestion of DB2 databases

Describe the bug Whenever launching a connection test or an ingestion to an IBM DB2 db we get a failure to connect:

Failed to test connection due to {"error": "Connection error from [Engine(db2+ibm_db://usrread:***@10.0.21.16:50000/pttttt)]: Unknown error connecting with Engine(db2+ibm_db://zzzuser:***@XX.XX.XX.XX:50000/YYYY): (ibm_db_dbi.ProgrammingError) ibm_db_dbi::ProgrammingError: SQLNumResultCols failed: [IBM][CLI Driver][DB2/NT64] SQL0104N An unexpected token "END-OF-STATEMENT" was found following "2.1.2"} */ SELECT 42". Expected tokens may include: "<table_expr>". SQLSTATE=42601 SQLCODE=-104\n[SQL: /* {"app": "OpenMetadata", "version": "0.12.1.2"} */\nSELECT 42]\n(Background on this error at: https://sqlalche.me/e/14/f405)."}

To Reproduce

Configure a DB2 connection and Test Connect

Expected behavior Ingestion of metadata from DB2

Version:

OS: IBM DB2 running on Windows

Python version: 3.9 on openmetadata ingestion server (docker)

OpenMetadata version: 0.12.1

OpenMetadata Ingestion package version: `openmetadata-ingestion[docker]==0.12.1 on which https://pypi.org/project/ibm-db-sa/ was installed manually on airflow python local environment

Additional context Python IBM DB2 support for SQL alchemy installed manually
opened by vdl-vciriza 0
timestamp/datetime column don't support value between

The requirement is to have test types through which we can validate minimum date/start date and maximum date /end date against a date column.

example : Column : National ID issuance date

test case 1 : To check National ID Issuance has max date (end date) as 31st Dec 2002, in order to check national ids which were issued before the defined cut off date.

test case 2: To check National ID Issuance has min date (start date) as 1st Jan 2003, in order to check national ids which are issued after the defined cut off date.

On Mon, 9 Jan 2023 at 14:12, Teddy ***@***.***> wrote:

@lailapatel https://github.com/lailapatel could you provide more details?

— Reply to this email directly, view it on GitHub https://github.com/open-metadata/OpenMetadata/issues/6704#issuecomment-1375377925, or unsubscribe https://github.com/notifications/unsubscribe-auth/A2L3ZR5EA7ABHO5TINW5GJ3WRPP77ANCNFSM56KTB7HQ . You are receiving this because you were mentioned.Message ID: ***@***.***>

-- [image: Email header] [image: Company logo] Laila Patel Data Governance Business Analyst www.moove.io https://s1.sendassets.io/s2/onr5697j *[image: facebook-f] * https://s1.sendassets.io/s2/ma1p4i37 *[image: twitter] * https://s1.sendassets.io/s2/3lnrjzed *[image: instagram] * https://s1.sendassets.io/s2/6b77t5x0 *[image: linkedin-in] * https://s1.sendassets.io/s2/l68rh2pf [image: Banner]

Originally posted by @lailapatel in https://github.com/open-metadata/OpenMetadata/issues/6704#issuecomment-1375388883
bug data quality support

opened by TeddyCr 0
UI: loaders are not shown in many places while fetching data from APIs
Affected module Does it impact the UI, backend or Ingestion Framework? UI

Describe the bug A clear and concise description of what the bug is. Loaders are not shown or not shown properly in many places while fetching data from APIs

To Reproduce

Screenshots or steps to reproduce

https://user-images.githubusercontent.com/51777795/211300525-079a1b52-6761-44e0-8e30-16800eff0c23.mov

Expected behavior A clear and concise description of what you expected to happen. Loaders should be displayed properly while any data is being fetched from APIs and show no data placeholders only when there no data is returned by the APIs

Version:

OS: [e.g. iOS]

Python version:

OpenMetadata version: [e.g. 0.8]

OpenMetadata Ingestion package version: [e.g. openmetadata-ingestion[docker]==XYZ]

Additional context Add any other context about the problem here.
UI
opened by aniketkatkar97 0
fix: Storage pvc logs

Is some content missing, wrong or not clear? In the Log's pvc need the same value for the storage, or the pv can bigger than pvc

Describe the solution you'd like Change the storage in pv to 10Gi

Additional context

documentation

opened by sergiopassoscb 0

Releases(0.13.1-release)

0.13.1-release(Dec 22, 2022)
What’s New in Release 0.13.1

Freshness Metric has been introduced. Data freshness is defined by how often a table is being updated and the number of rows being affected. All this is displayed within the data profiler with filterable graphs. This is currently supported for BigQuery, Snowflake, and Redshift.

Data Quality Tests now support Data Lake services.

Notification Support experience has been improved. Users can define Alerts based on a Trigger (all data assets or a specific entity), Filters (events to consider), and Action (Slack, MS Teams, Email, Webhook) on where to send the alert.

dbt has its own workflow. Previously, dbt was a part of the metadata ingestion process. This allows users to ingest multiple dbt projects into the same database service.

Topic Schemas support field descriptions and tags. Previously, they were read-only. We now support JSON Schema, Avro and Protobuf parsing and field level details for topic schemas.

Data Insight Report has an improved layout. We now display a line graph instead of a bar graph. The Most Viewed Data Assets are clickable to view the asset details page.

Advanced Search improvements have been made. When a filter is applied, the details of the filter selected are displayed for clarity.

Side Preview on the Explore page UI is now available for all data assets. Previously it was only displayed for tables.

Airflow Lineage Operator and the OpenMetadata Hook are now part of the ingestion package. Send Airflow metadata from your DAGs and safely store the OpenMetadata server connection directly in Airflow.

What's Changed

fix: Docs for Authrizer Ingestion Principals deprecation note by @akash-jain-10 in https://github.com/open-metadata/OpenMetadata/pull/8997

bump(ui): webpack loaders by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8921

Check old query users by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8998

Fix minor data insight bug by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8999

Add table query test by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9000

UI : fix the search bar issue having quote in the search text by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9012

Fix BQ Ingestion condition by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9015

Added data insights docs + update profiler CLI to include partition by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9010

Fix #8995 Change any references to Kpi or kpi should be KPI by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9014

Feat(UI)#3474: Localization changes part - 1 by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9016

Cypress: Added log1 flow for services spec by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8900

Return 400 if airflow rest health fails by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9018

kpi resource test task done by @07Himank in https://github.com/open-metadata/OpenMetadata/pull/9006

Docs - Bare metal minimum requirements by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9032

Fix #8571 - Log IngestionPipeline status change to CloudWatch by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9013

chore(ui): remove all todo comments and unwanted types by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8825

Cypress: Added coverage for collect endpoint by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9027

Fix #9042: query is being indexed causing huge payload returned by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9043

UI : - Disable the name field file while editing Ingestion by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9023

Fix 9026 - Remove Click Dependency by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9030

E2E for Bigquery by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9007

Fixes #6760 -- Implements REGEX for regex test by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9033

fix: customOidc env and variable name by @akash-jain-10 in https://github.com/open-metadata/OpenMetadata/pull/9050

fix(ui): localization keys for constants files by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9051

Fix: atlas connector by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/9034

Add micrometer page view metrics by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9062

Added: Postgres env credential in cypress workflow file by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9056

Bump loader-utils from 2.0.0 to 2.0.4 in /openmetadata-ui/src/main/resources/ui by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/9052

Fix #7486 - Docs - Update OM quickstart version by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9061

fixed typo in GKE doc by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9063

Update roadmap for next 3 releases by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9036

Fix logging metadata webhook event by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9067

Fix #8991: Index fully qualified table name for search by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9035

Fix #8579: Add unit test to cover the cases where columnProfile is null or not being sent by client by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9038

Fix #9008 - Add Airflow callback, introduce Workflow Status Mixin and remove retries by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9049

removed-whitespace-from-postgres-and-redshift by @codingwithabhi in https://github.com/open-metadata/OpenMetadata/pull/8927

Docs - Postgres version requirements by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9070

fix(ui): localisation for constant files by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9066

Cypress: Added postgres connector and usage test by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9053

Removed tailwind class from pages component part 1 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9054

UI : Remove whitespace in the name by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9057

Fix Credentials sent via env by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9071

Fix(UI) #8555: Tags removal issue by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9055

Fix#6203: Refactor LineageRunner use by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/9073

fix(ui): connection form missing for new connectors by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9084

Fix #8993 Add Datainsight ingestion option available even after a pipeline already running by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9075

Bump postgresql from 42.5.0 to 42.5.1 by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/8992

add required fields for amundsen connection by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9039

Cypress: Enable the skip test and fix failing test by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9048

Fix 9093 : Search Card Link to smoothly route instead of loading the whole page by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9094

Fix#7690: Use ES to build Tables FQN when processing Lineage by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/9079

Fix #8083: Adding a child term to a parent term in glossary produces error by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9088

Fix #8323: GenerateToken can overwrite any relations that user may have by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9091

Fixed ctrl + k is not working as expected #7824 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9096

Fix: Safer default Mark Deleted Tables by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/9065

Lineage Backend example and status fix by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9095

fix(ui): wrong relative time being rendered by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9098

Fix: dagster issue 'nodes' by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/9099

UI : Make the Activity card popup style similar to explore page by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9028

Cypress: Fixed dropdown click issue for appbar by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9106

Docs - Python SDK installation by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9101

Fixed: [UI] Add support for renaming glossary #8733 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9105

Fix #8846 : Replace Confirmation modal with antd modal in the UI -1 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9074

fix(ui): hide elasticSearchIndex page for non-admins by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9077

fix(ui): tags description was going out of the view by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9120

UI : Revamp Teams page by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9107

Fixed Broken docs links for ingestion by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/9125

Fix #8858 - Add chart description and add lineage flexibility by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9124

Cypress: Added test related to redirection from home page by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9112

Fix #8846 : Replace Reviewer and deploy ingestion modal with antd modal in the UI -2 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9076

UI : Use Backend system level flag for system tags by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9126

Fix #6463: Add support for default suggestions for suggestion API by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9090

Bump decode-uri-component from 0.2.0 to 0.2.2 in /openmetadata-ui/src/main/resources/ui by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/9129

Add E2E env by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9136

chore(ui) : Check for preferred_username while signup by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9102

Fix: aggregate type by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/9138

Fix #7056 - Automatic lineage from ML Model to ML Feature Data Source by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9113

Fix(UI)#9017: Fixed description not rendering on explore page in Safari browser by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9144

Fix E2E: new envs by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9143

Fix(UI)#8970: Fixed issue with user created Metadata Services not able to be deleted by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9140

UI : Add sidebar for data insight tabs by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9146

Fix #9139: Fix shcema filter being added twice to status by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/9148

Updated all workflows for issue #9141 by @dhruvinmaniar123 in https://github.com/open-metadata/OpenMetadata/pull/9147

Update AbstractEventPublisher.java by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8828

Fix #9123 - Add owner and tags to Airflow DAGs by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9135

Added java distribution by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9160

Track new primary key by @07Himank in https://github.com/open-metadata/OpenMetadata/pull/9145

Fix #8846 : Replace what's new modal modal with antd modal in the UI -3 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9081

Fixed failing flaky cypress tests. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9150

UI: Added support for renaming user generated tag category by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9154

Fix : Do not render the slack chat component directly as child of router switch by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9166

Fix : Logs screen for data insight pipeline is hanging by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9165

Fix #8846 UI: Replace all the modal with antd modal in the UI -4 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9086

Fix(UI)#7173: Fixed issue where soft deleted tables were showing on schema details page by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9169

UI : Remove Y-axis for percentage charts on data insight page by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9175

bump(ui) : [email protected] to [email protected] by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9173

Fixed time field type for profiler by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9177

Fix(UI): Fixed localization keys. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9164

Fix typos in JSON schemas and follow standard naming convention by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/9183

Fix #9040: Remove fields such as tableQueries, tableProfile, tests, sample data as part of table fields by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9041

UI: Added localisation support for ui by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9171

Fix #8083: Follow-up fix to add glossary terms by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9191

Fixes #9167 - Default value for SLACK_CHAT_SLACK_URL by @talalio in https://github.com/open-metadata/OpenMetadata/pull/9174

Fixes #7447 -- Add freshness metrics to profiler by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9159

Fix(UI): Fixed UI errors for changes in PR #9183 by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9200

Fix #9156: database service count not showing up in landing page by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9157

Fix: #1308 Docs and Atlas Connector Improvement by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/9072

Add: function to get different catalogs by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/9179

UI : Data Insight KPI improvements by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9188

Fixed lineage search issue and added unit test by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9213

UI: Add support for showing created and updated information to Glossary Term in the UI #3113 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9190

Added SSL Connection steps for Clickhouse connection by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9210

Fix(UI): Fixed tables from all the services showing on database Schema page by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9202

Fix(UI): Regression in search filters by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9214

Solve issues related to actitivity feed by @07Himank in https://github.com/open-metadata/OpenMetadata/pull/9199

Fix #9181 - Handle failed callback status without workflow by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9193

locale (ui) : add localization support for UI labels -2 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9215

Fix #9044 - Add prometheus event monitor by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9176

feat(ui) : Add search dropdown by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9122

Added french translation by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9222

Fixes #9192 - Update ES response for DI by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9221

Added localisation support part 2 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9220

Fix #9218: Fix glossary and glossary term deletion updates to ES by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9225

Fix(#9226): do not show error for public IP resolution by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9230

Fix(#9137): UI: Delete button not visible for connection options and connection arguments by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9231

Fix 7278: add test connection by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9196

Fix #9182 - Airflow Lineage Operator & Airflow lineage state by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9206

Add LRU to ES fqn by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9233

Fix #9227: Fix metabase connector to work with non-admin user by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9228

Remove Test case URL encoding by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9247

Schema for Alerts by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/9249

UI :- Added functionality to drag and drop teams in another team by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9152

Fix Get sample data for e2e tests by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9252

Fix (#9238) : Dashboard owner and tags not appearing on dashboard list by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9250

UI : fix add owner and tier functionality on Translated entity page by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9244

Fix #9205 - Fix CustomPipelineConnection java class by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9243

Fix deployment docs by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9229

Fix #9116 & #8284 - Clean tableau source, fix ownership, add description and SSL verification by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9241

Fix#8424: Remove brackets from tables and schemas on lineage by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/9257

Airflow APIs - Don't fail if missing IP by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9253

Fix #8944: Added pagination logic for PowerBi by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/9263

Fixes 9192 - Add entity link in response by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9239

Fixes #9025 -- Added deletion of WebAnalytics events in dataInsight Workflow by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9208

fix(ui): add description around filter pattern by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9133

UI : Added add test suite functionality in test suite page by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9236

Fixes #8184 Athena Profiler by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9270

Improvements(UI) #9003: Improved explore page advanced search quick filters styling and functionality by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9237

Logic improved for BYTES column by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/9261

UI : Fix pagination issue in test case by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9271

Fixed SQL query missing when a data quality test is edited #8341 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9268

Fix#4648: Use ES call to get table entity by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/9273

feat(ui): localisation for utils and models by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9265

Fixed API throwing error while fetching soft-deleted MLmodel entity #5596 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9262

doc : add missing doc links by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9280

fix(#9240) Data Insight Latest Value for Percentage of Entity Description is Not Correct by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9285

Fix: added datalake gen2 by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/9245

Fix(UI) #9277: Fixed issue with dropdown options not resetting for different drop-downs by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9279

Fix #8509: Add schema fields by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9209

Feat: Add freshness + rows inserted graphs on the UI side#9117 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9203

Add Test Suite Implementation for Datalake by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9235

Fix Clickhouse Comments by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/9295

Alerts by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/9267

e2e: DataConsumer Role test by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9298

Fix #9217: Add Support for Endpoint URL in Datalake by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/9293

Fix: Datalake s3 get list of files by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/9294

Integrated schema parsers by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/9305

UI: Data insight feedback part 1 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9308

Feat(UI) #8060: Adding highlight for searched items in dropdown. #8060 by @karanh37 in https://github.com/open-metadata/OpenMetadata/pull/9307

Fix (#9087) : Search, show the condition after user applies the Advanced Search by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9303

Fix MlModel Lineage edge order by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9274

UI : Add localization by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9309

Openmetadata workflow issue 9172 by @dhruvinmaniar123 in https://github.com/open-metadata/OpenMetadata/pull/9299

UI: Data-insight feedbacks part 2 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9313

fix(ui): cypress failure for webhook, slack, msteams by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9315

Fixes for Alerts by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/9316

Deprecate configurations for auth provider configuration on Airflow by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8896

Fixes #9290 Policies Don't Prevent Custom Properties Modification by … by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/9327

UI/UX improvements part-1 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9304

Fix: Snyk Severity for Delta Spark by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9323

Fix#9251: DB2 connection config and ingestion update by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/9322

Added percentage computation for tier chart and added functionality of on hover chart will be focus by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9319

remove norms for ES index mappings by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9334

Fix(UI) #9331: SearchDropdown improvements and bug fixes. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9333

Fix #9058: Add time elapsed in seconds instead of mili-seconds by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/9310

Fix failure in GCS datalake ingestions by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9336

UI : Restricted special character for Glossary and Term by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9288

UI : Lineage UI improvement by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9312

UI : fix the required filed issue in Profiler setting Modal by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9337

Feat(UI) #9204: Added preview panel for all the data assets. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9318

Created ActivityFeed Alert by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/9339

UI : Clean up data insights summary and KPIs by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9335

Dbt worflow by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9302

UI : downgrade [email protected] to [email protected] by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9338

UI: update the KPI side text by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9343

Fix: Metadata backup Azure blob issue by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/9328

Fix #9283: Description and tags are not getting updated for schema fields by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9325

Fix: making token as optional field by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/9314

fix(ui): minor improvements around fonts and page sizing by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9332

Fix: Update Ingestion docker images and fix python libraries dependencies by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/9342

UI: DataInsight feedback part 4 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9345

Fix: updated docs for dagster by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/9350

Fix: Bot roles missing after edition by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/9351

Fix #9276 - Fix dump syntax for backup by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9341

Fixes #5522 by implementing timeout for the profiler by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9340

UI: Summary panel improvements. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9347

Alert Fixes : removed redundant files, updated Triggwe by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/9346

Fix #2435: Add tagging support for services and database by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9330

Code cleanup changes by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/9361

chore(ui): cleanup activity feed from settings page by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9362

Fix Mysql e2e test by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/9364

Fixe Ownership and Tier Processing by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9356

Airflow e2e integration test by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9363

Add arg in backup doc by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/9360

UI: Converted data insight dropdown to checkbox dropdown by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9368

UI : Added Organization displayName in DataInsight health glance by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9359

Cypress: skipping flaky cypress test by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9369

UI : Added auto-generated password on page load by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9367

Fix : Pipeline execution results overflow by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9366

Fix: updated docs for datalake-azure by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/9358

UI : Fix missing header of User and Admin table by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9371

doc : Add what's new for 0.13.1 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9375

Minor change in backup function by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/9370

Alert improvements by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/9374

Fix(UI)#8737: Converted edit description modals into antd modals by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9373

UI : User profile page improvements by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9376

Pagination query task by @07Himank in https://github.com/open-metadata/OpenMetadata/pull/9377

Fix #7528: Fix caching issue for BQ by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/9352

Fixed failing cypress for glossary by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9380

feat(ui): update alerts experience with generic approach by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9297

UI: Added relative percentage change details in UI by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9354

Fix: Databricks table type issue by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/9385

Alert Fixes, Removed Alert and AlertAction from Entity List, Get late… by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/9386

UI: Fixed Pagination issue on dataset details page by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9387

DBT ingestion improvements by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/9383

Improvements(UI): Summary Panel improvements by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9396

Fix(UI)#9381: Task details page bug fixes. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9390

Databricks improve code and doc update by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/9394

UI : Fix alignment and spacing issue by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9379

Fix DBT HTTP source error by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/9397

Fix(UI)#9405: Fixed multiple API calls made repetitively on the homepage page. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9406

UI: Data insight feedback part 6 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9403

Fix(UI)#9232: Error while fetching the profiler details for tables with special characters in the name. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9392

fix(ui): edit alert and misc feedback for alerts page by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9388

UI : Added header and sub-headers for the page by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9378

UI : Dbt Workflow Improvement by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9404

UI: Fixed test case value preserve issue and test case graph improvement by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9409

Fixes #9393 - Fix perc. computation for entityTier by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9398

Fix OM backup by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9395

refactor : use generic function for table ExpandableConfig by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9410

Fixed#9289 : Support Data Insight Index Refresh from Elastic Search by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/9412

Fix data insight filtering by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9415

fix 7995: profileSample % and row number by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9104

UI: Updated Tier label in data insight chart by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9417

UI : fix cypress issue for while deleting service by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9416

Snowflake E2E Tests by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8781

Fix : Advanced search improvements by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9413

UI:0.13 UI feedback - Part 2 #9184 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9422

Added DBT Workflow fixes by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/9419

UI : downgrade [email protected] to [email protected] by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9424

Fix data freshness bugs by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9423

UI: Fixed count issue for delete modal by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9430

UI: Added more information for table columns in summary panel. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9420

Fix:minor changes in atlas by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/9418

UI: Improvements from #9242 by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9434

Add port mapping for MySQL docker compose by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9436

Fix: Wrong services count returned from UtilResources by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/9425

UI : Fix the missing drag icon from Teams Table by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9429

Azure datalake minor changes by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/9407

Fixes #9060 -- Implement migration cmd by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9437

Fix topic indexes and migrations by @harshach in https://github.com/open-metadata/OpenMetadata/pull/9439

Add more context to airflow exceptions by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9441

Added Test cases for Alerts + bug Fixes by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/9421

UI : Change dbt label to lowecase and remove dbt remove from Database … by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9447

doc : Update what's new for 0.13.1 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9451

UI: Worked on UI improvement and spacing issue by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9443

Added pagination to Report Data by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/9440

feat(ui): alert details page by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9454

UI : Lowercase DBT label in WhatsNewPage by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/9456

Add docs for data quality by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/9457

docs: Update Airflow volumes docs by @akash-jain-10 in https://github.com/open-metadata/OpenMetadata/pull/9458

Added dbt breaking changes docs by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/9453

Add freshness documentation by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/9449

UI: Fixed redirection link in add test suite page by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/9464

fix: Add docs for running the metadata CLI for backup in k8s upgrade by @akash-jain-10 in https://github.com/open-metadata/OpenMetadata/pull/9465

Redpanda Ingestion Fix by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/9468

Docs - Docker 0.13.1 upgrade instructions by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/9438

fix(ui): add beta tag for notifications by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9471

Added the default volumes for ElasticSearch by @Vj-L in https://github.com/open-metadata/OpenMetadata/pull/9452

doc : Update what's new for 0.13.1 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/9474

Ingestion Bot Fix + AcitvityFeedAlerts Update by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/9475

UI: Improved quick filters search dropdown functionality. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/9455

fix: GKE k8s Docs by @akash-jain-10 in https://github.com/open-metadata/OpenMetadata/pull/9467

bump(version): prepare for 0.13.1 release by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/9478

New Contributors

@07Himank made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/9006

@dhruvinmaniar123 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/9147

@talalio made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/9174

@karanh37 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/9307

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.13.0-release...0.13.1-release
Source code(tar.gz)
Source code(zip)
docker-compose-postgres.yml(6.11 KB)
docker-compose.yml(6.06 KB)
openmetadata-0.13.1.tar.gz(95.54 MB)
0.13.0-release(Nov 23, 2022)

OpenMetadata 0.13.0 Release Highlights

Data Insights and KPIs

Data Insights, a game-changing feature, has been introduced that transforms the passive approach to data into a collaborative project toward improved data culture. Data Insights aims to provide a single-pane view of all the key metrics to best reflect the state of your data. OpenMetadata gathers all the metrics related to the metadata that you are extracting. The entities created the types of entities and the data evolution over a period of time. Based on these metrics, we provide analytics to assess the gathered data.

Admins can define the Key Performance Indicators (KPIs) and set goals within OpenMetadata to work towards better documentation, ownership, and tiering. These goals are based on entities and driven to achieve targets within a specified time. For example, Admins can set goals to have at least 60% of the entities documented, owned and tiered by the end of Q1 2023.

The data insights dashboard provides a quick glance at aspects like data ownership, description coverage, data tiering, and so on. Teams can view a timeseries report to track progress and monitor the health of your data. In addition to the metrics on data, Admins can view the aggregated user activity and get insights into user engagement and user growth. Admins can check for Daily active users and know how the tool is being used.

The Data Insights Report is emailed weekly, so that teams can assess their performance relative to the KPIs set at an organizational level to improve data culture on an ongoing basis.

Lineage

The lineage UI has been transformed to enhance user experience. Users can get a holistic view of an entity from the Lineage tab. When an entity is selected, the UI displays end-to-end lineage traceability for the table and column levels. Just search for an entity and expand the graph to unfold lineage. It’ll display the upstream and downstream for each node.

The Lineage Tab UI supports two-finger scrolling to zoom in or zoom out.

Data Quality

With the OpenMetadata UI, users can now create and deploy profiling workflows for the Datalake connector, which supports AWS S3 and GCS. In the next release, we’ll add the support to run tests as well as covering Azure ADLS. Security With the addition of the LDAP SSO in the current release, OpenMetadata supports nine SSOs, which includes Google, Azure, Okta, OneLogin, Auth0, Amazon Cognito, Keycloak, and custom OIDC. In the 0.12.1 release, support was added for basic authentication to sign up using a Username/Password.

OpenMetadata Roles and Policies treat Bots as a special user with access to all the APIs and entities, just like an Admin. Bots have been in use for ingestion to extract metadata, as well as for data profiler and so on. In the 0.13 release, we’ve created multiple bots to serve different scenarios. For example, Ingestion Bot, Lineage Bot, Data Quality and Profiler Bot.

Given the varying roles for specific bots, the policies and access control for bots has been redefined. Now, Bots can have their own policies. For example, the Ingestion Bot can create and update entities. The Profiler Bot can only update the profile of a table, and not have policies for any other entities or access to update table description, etc.

Advanced Search

OpenMetadata already supports advanced search syntax. Since it is syntax-driven, it’s not easy to use for all except advanced users. In the current release, a Syntax Editor has been introduced for advanced search with And/Or conditions that help discover assets quickly. A huge thank you to Cristian Osiac from Bloomberg for helping with this feature.

New Connectors

In the 0.13 release, we have introduced four new connectors:

Domo, a cloud-based dashboard service. The Domo Business Cloud is a low-code data app platform that takes the power of BI to the next level by combining all your data and putting it to work across any business process or workflow. OpenMetadata supports Domo as a Database, Dashboard, as well as a Pipeline service.

Hacktoberfest has been a complete success at the OpenMetadata community, with three connectors being developed as part of the event:

AWS SageMaker, a fully managed machine learning service, where data scientists and developers can quickly and easily build and train machine learning models, and then directly deploy them into a production-ready hosted environment. AWS Kinesis, a cloud-based messaging service that allows real-time processing of streaming large amounts of data per second. AWS QuickSight, a cloud-scale business intelligence (BI) service that allows everyone in the organization to understand the data by asking questions in natural language, exploring through interactive dashboards, or automatically looking for patterns and outliers powered by machine learning.

Big thanks and congratulations to Michael Zhou for developing AWS QuickSight and to Tushar Mittal for adding both AWS SageMaker and AWS Kinesis. Several improvements have been made to the ingestion framework. In the 0.12.1 release, we shipped the ability to add a custom service type. Users can now develop their own connector and ingest it as with any other supported service! If you’d like to learn more about that, you can check out the demo!

Messaging Service Schemas

Major enhancements have been made to how data is extracted from Kafka and Redpanda Messaging services. Previously, OpenMetadata extracted all the Topics in the messaging queue and also connected to the Schema Registry to get the Schemas. These schemas were taken as one payload and published to OpenMetadata. We now parse Avro and Protobuf Schemas to extract the fields. Now, users can document each of these fields within a schema by adding descriptions and tags. Users can search based on the fields in the Schema of a Topic.

Other Changes

Soft deleted entities can be restored. Currently, only the ML Models are not supported. Soft deleted teams can be restored. When restoring a soft deleted parent team, the child teams will not be restored by default.
Source code(tar.gz)
Source code(zip)
docker-compose-postgres.yml(7.93 KB)
docker-compose.yml(7.85 KB)
openmetadata-0.13.0.tar.gz(94.19 MB)
0.12.3-release(Nov 18, 2022)
What's Changed

Fix #8744: Fix user suggestion by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8745

Tag Cache and Glossart Term cache by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8856

Release 0.12.3 - Updated the required files by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8879

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.12.2-preview...0.12.3-release
Source code(tar.gz)
Source code(zip)
docker-compose-postgres.yml(7.85 KB)
docker-compose.yml(7.79 KB)
openmetadata-0.12.3.tar.gz(90.04 MB)
0.13.0-preview(Nov 15, 2022)
What's Changed

fix(ui-test): segmentation fault error unit tests by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/7840

Doc: Fix Profiler documentation by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8136

Fix #7898 - DockerOperator and GCS K8s operator docs by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8137

Remove inconsistent space in docker-compose files by @sfirke in https://github.com/open-metadata/OpenMetadata/pull/8138

Add: databricks usage and lineage added by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/7386

Update jackson version by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8141

FIX: Add Databricks usage and lineage details by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/8130

ISSUE-1986: Replace System.out, System.err by a logger by @shivamshrey in https://github.com/open-metadata/OpenMetadata/pull/8139

Fix #5492: Fix Trino Comments by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8113

Fix: SonarCloud coverage for Python code by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8144

Fix Keycloak documentation by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8149

Fix: Sonar coverage test run only for Python 3.9 by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8151

Update older dependency versions by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8152

Fix#8097: Test Suites UI Name Fix by @u7283219 in https://github.com/open-metadata/OpenMetadata/pull/8156

Tag PATCH + Cleanup of helpers methods by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8150

FIx #7477 Add logic to fetch log use react-lazylog by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8111

UI : Make AuthMechanism Fields to readOnly from NonEditable by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8143

Update Airflow Documentation by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/8179

Revert "ISSUE-1986: Replace System.out, System.err by a logger (#8139)" by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8163

FIX: connection failed because of having '@' character in uname and pass by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/8172

UI: Added unit test for profilerDashboardPage and profilerDashboard component [part 1] by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8178

UI: Add Cypress for DTB in redshift container by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8162

Feat (#7561) Announcements are not supported for MLModel from UI by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8109

FIX #8169: modify Antlr4 CLI installation guidelines to be more prominent by @finn-mcclusky in https://github.com/open-metadata/OpenMetadata/pull/8183

Fix SonarCloud coverage XML file by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8177

Docs: Update openmetadata-server.md by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8197

Bump json-pointer from 0.6.1 to 0.6.2 in /openmetadata-ui/src/main/resources/ui by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/8142

UI: Added Unit test and localisation support for profilerTab component [Part-2] by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8190

UI: Upgraded react flow library from V10 to V11 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8201

Bump tmpl from 1.0.4 to 1.0.5 in /openmetadata-ui/src/main/resources/ui by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/8198

Fix #8204 UI : While login just show the loader in login button. by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8205

Added DOMO Pipeline by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/8133

bump(ui): upgrade html-webpack-plugin to v5 by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8210

Fix (ui) :- Tag dropdown overflow issue and added localisation by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8173

Fix UI :- Missing close icon from modal by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8112

UI :- Added option to remove Owner and Tier by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8087

Added dagster version and hostPort issue docs by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/8212

Doc : Add How to guide for Custom Property by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8209

Use postgres 14 by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8207

Bump urijs from 1.19.7 to 1.19.11 by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/8024

Bump moment from 2.29.1 to 2.29.4 by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/8213

Adding Exception to Logger , and update batch jobs status as well by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8217

FIX: Trino&Presto catalogs as databases by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/8189

Fix#8231: Docker Volumes Postgres Documentation Fix by @u7283219 in https://github.com/open-metadata/OpenMetadata/pull/8233

Update README using image committed into repository by @mavimo in https://github.com/open-metadata/OpenMetadata/pull/8230

Refactor initializing system entities from data files for better reus… by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8234

Fix/env variable by @Vj-L in https://github.com/open-metadata/OpenMetadata/pull/8199

Bump ansi-regex from 4.1.0 to 4.1.1 in /openmetadata-ui/src/main/resources/ui by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/8238

Bump terser from 5.7.1 to 5.15.1 in /openmetadata-ui/src/main/resources/ui by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/8218

Remove default debug enable by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8195

bump(ui): update @svgr/webpack security issue around nth-check by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8219

bump(ui): recharts deps to v2 by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8203

Update: Trino&Presto catalog Details by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/8225

Update: Note in oracle doc by @meet1999-cloud in https://github.com/open-metadata/OpenMetadata/pull/8222

Add metadata main by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8247

Feat ✨ (#8159)Implement Web Analytics logic from frontend by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8181

Fix Datalake Json Error by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8246

FIX(UI) #7834: unable to type and search in the Teams dropdown by @finn-mcclusky in https://github.com/open-metadata/OpenMetadata/pull/8245

Bump nth-check from 2.0.0 to 2.1.1 in /openmetadata-ui/src/main/resources/ui by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/8250

Add Domo Database Connector by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/8221

Fix(UI): Inconvenient search in lineage #8077 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8229

Added project id to DBT cloud config by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/8062

Fix test suite bug for redefined quotes by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8248

fix: Conditions and missing packages for Release process by @akash-jain-10 in https://github.com/open-metadata/OpenMetadata/pull/8262

feat(ui): support test connection option for services by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8249

fix(ui): invalidate token on logout via API call by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8243

fix(ui): replace tab with antD tabs by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8092

Updated the tags by @Vj-L in https://github.com/open-metadata/OpenMetadata/pull/8266

Bump jackson-databind from 2.13.4 to 2.13.4.1 by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/8242

[BOT] User Cache for accessing Jwt For Bot by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8267

Fixes #8236 - Initialize bots from JSON data files by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8237

Revert "Bump jackson-databind from 2.13.4 to 2.13.4.1 (#8242)" by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8272

Revert "Fixes #8236 - Initialize bots from JSON data files" by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8281

fix: Update Azure SSO Docs by @akash-jain-10 in https://github.com/open-metadata/OpenMetadata/pull/8186

Cypress: Fixed flaky cypress for mydata and DBT spec by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8257

UI :- Added EmptyPlaceholder for no data Modal store by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8220

Fix: Improve error messages in the CLI and update dashboard YAML example files by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8286

Fixes issue with Table name containing excluded endpoints by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8289

Fix #8283: Using ES instead of get_by_name API for DBT source by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/8288

bump(ui): Upgrade react-quill from 1.3.5 to 2.0.0 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8277

Fixes #8121 -- Report endpoint for data insight by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8122

Fixes #8154 - Add collect endpoint for web analytic events by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8193

Fix ISSUE-3790: Remove unnecessary public modifiers by @shivamshrey in https://github.com/open-metadata/OpenMetadata/pull/8268

Revert "Fix ISSUE-3790: Remove unnecessary public modifiers (#8268)" by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8295

Snowflake & S3 permission update in docs by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8296

fix(ui) : Remove icon visible in Dropdown other than owner by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8291

Fix documentation about volumes by @alancmag in https://github.com/open-metadata/OpenMetadata/pull/8297

Fix UI: Improve add user into team flow #7789 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8106

Added unit tests for Signup page. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/6509

Refactor(UI): Refactor lineage component code by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8269

Feat ✨(#8258) Integrate Collect API on UI to collect the pageView Data by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8260

UI :- Added Redeploy option in Ingestion Pipeline action by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8251

Bump Snowflake & importlib versions by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8300

Added DBT col level lineage using queries by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/8176

Fix #7477 - Paginate Airflow logs by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8145

Fixes #8236 - Initialize bots from JSON data files by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8304

FIX 8196: Remove the create-ingestion-bot and update-ingestion-bot from bootstrap_storage.sh by @finn-mcclusky in https://github.com/open-metadata/OpenMetadata/pull/8202

Airflow Managed Apis - Support Airflow 2.2.2 by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8273

Fixes #8313 Deprecate botPrincipals from open metadata configuration by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8314

Issue-8315: Parameter 'input' on the metadata restore CLI not working by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8317

Airflow APIs docs by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8312

ISSUE-1987: Replace thread.sleep with awaitility library by @ssandy83 in https://github.com/open-metadata/OpenMetadata/pull/8305

Fixes #8394 Use Awaitility pollInterval instead of iteration loop by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8325

Corrected null checks by @MaheshGPai in https://github.com/open-metadata/OpenMetadata/pull/8320

Update javadoc plugin version by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8329

Fix #8282 - Disable timeout for windows by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8331

Fix lineage issues with merge_into and copy grants queries by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8335

Update maven plugins by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8330

change sampling method for snflk by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8336

Bump jackson-databind from 2.13.4 to 2.13.4.1 by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/8316

Fix databind version by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8339

Bump jackson-databind from 2.13.4 to 2.13.4.1 by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/8340

Fixes #8326 Add roles to system bots during initialization and use po… by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8327

add fix for issue-7710 - dead links in sdk docs by @katebmckay in https://github.com/open-metadata/OpenMetadata/pull/8328

Doc: Update Java prerequisites for build code by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8348

Fixes #8343 Differentiate create from update in PUT operations by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8344

Fix lineage to support 'merge into' queries starting with comments by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8355

Domo exception management by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8360

Fixes #8206 -- Implement data insight refinement for entity report data by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8351

Add missing calls to 'clean_raw_query' when using LineageRunner by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8363

UI (#6189) | Refactor Explore and ExplorePage, add Logical Query Builder by @mosiac1 in https://github.com/open-metadata/OpenMetadata/pull/8140

Fixed Issue#8342 by @javamultiplex in https://github.com/open-metadata/OpenMetadata/pull/8365

Fix #8307: Fixed DBT test case issue for sources with no DB/Schema names by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/8308

ISSUE-7848: Fix variable names as per naming convention by @shivamshrey in https://github.com/open-metadata/OpenMetadata/pull/8228

document MS Teams webhook by @sfirke in https://github.com/open-metadata/OpenMetadata/pull/8356

Remove INITIAL_FROM constant to fix UI tests by @mosiac1 in https://github.com/open-metadata/OpenMetadata/pull/8367

Issue 4868: Add support for Azure Blob by @amymareemc in https://github.com/open-metadata/OpenMetadata/pull/8334

Airflow APIs docs by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8368

Domo Pipeline - Use pipeline ID with display name by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8374

Fixes 8371 Remove bot flag from authorizeAdmin method by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8372

FIX(UI): #8261: Handle Loading States In a Better Way by @finn-mcclusky in https://github.com/open-metadata/OpenMetadata/pull/8309

UI : Change App bar items by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8302

Fixed incorrect const import in cmd.py by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/8380

UI :- Added loading state on Save button in Modal by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8185

Patch ingestion image security libs by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8385

Fix: Sonar Cloud Python coverage by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8386

Fix: Update Maven dependencies by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8383

Remove unused methods in ResultList implementations by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8378

Fix: Update py-test workflow by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8394

[LDAP] Added Ldap-Authentication by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8256

Fixes #8401 Remove lingering authorizeAdmin in TagResource by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8403

Fix UI :- fix the Team redirect url in mentions by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8384

Fix UI :- Added Row count separator in table entity by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8393

Fix sonar: Use try-with-resources and handle exception by @ShajithaMohammed in https://github.com/open-metadata/OpenMetadata/pull/8414

Fix #8361 Ingestion logs pass wrong breadcrumbs and URL by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8382

Fix #8396 Multiple webanalytics events send per single page load by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8402

Remove authorizer for the collect endpoint by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8398

Airflow exception management by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8410

Fix headings by @Youssef1313 in https://github.com/open-metadata/OpenMetadata/pull/8423

Cypress: Fixed failing cypress for role page by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8381

Docs - AzureSQL troubleshooting by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8427

Create SECURITY.md by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8437

Update GID used in ingestion docker images by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8434

Update Okta documentation by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8433

Fix sonar issues by @ShajithaMohammed in https://github.com/open-metadata/OpenMetadata/pull/8421

Upgrade maven plugins by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8441

Updated the volume document and one community user ticket by @Vj-L in https://github.com/open-metadata/OpenMetadata/pull/8440

Fix/volume docs by @Vj-L in https://github.com/open-metadata/OpenMetadata/pull/8444

Removed unnecessary docker-compose files by @rahulsurwade in https://github.com/open-metadata/OpenMetadata/pull/8085

Ingestion image - Remove expat version by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8445

Ingestion Image - Remove expat version release and CI by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8447

Remove Click and Add ArgParse by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/8182

Fix UI :- Fix the active tab for explore page after refresh by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8420

Fixed#8354: Support Login For User from multiple devices with different refresh tokens by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/8454

UI: Added expand all column button and full screen view for lineage by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8425

Fix UI :- fix the window resizing issue in Service page on hover by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8459

Fix #8450 Explore page pagination not working by @mosiac1 in https://github.com/open-metadata/OpenMetadata/pull/8451

UI: Fixed filter issue on redirection from tags page to explore page by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8457

Fix #8461: Vertica query syntax issue fixed by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/8463

FIX: Add postgres usage and lineage details by @clueless-bot in https://github.com/open-metadata/OpenMetadata/pull/8456

Fixes #6681 Add support for policy evaluation API by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8466

Fixed: Custom property failing cypress test by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8460

Feat ✨(ui #8160) : Implement Analytics report page by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8294

Fixed abstract init issue by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/8446

Databricks + DBT issue by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/8391

fix(ui): show full content for ellipsis column names by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8443

Fix UI | Enable 2-finger scroll zoom-in/zoom-out on the Lineage tab#6942 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8477

Fixes #7810 - Allow to only pass min or max by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8474

Fix #7802 Differentiate Tags & Glossary Terms by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8471

Fixed#8239: Query mismatch while searching for - and _ makes data overlap by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/8476

UI :- Added restore option for soft deleted Teams by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8306

Add Unit tests for data insight component part1 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8469

Fixes #7004 Backend : conditionAllow should not be applicable to crea… by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8483

Fix: Athena connector fails to ingest complex types by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/8453

Revert #7292 : Add ConditionalAllow check for Create Operation Permission by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8488

chore(ui): remove unused files by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8487

Fix #6754: Added User Details for Usage by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8449

Fix #6173 - Bump datamodel-code-generator by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8492

feat: add Kinesis connector by @techytushar in https://github.com/open-metadata/OpenMetadata/pull/8452

Airflow connections docs by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8493

Fix UI(#8467) : Only allow admins to create and update bot and user entities by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8491

Add support for system provided Tags, Glossaries, Policies, and Roles… by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8508

Fixed Cypress flakiness for add owner test in service spec by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8504

Fix #8497 Update Table styling by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8498

#7994 Updating password error message to mention numbers. by @mihirk11 in https://github.com/open-metadata/OpenMetadata/pull/8103

Fix #7767: Added new PowerBi APIs and lineage by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/8485

Fix #6141: Ingestion Pipeline Status Updates by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8216

Fixes #8353 - Implement Aggregation Endpoint for dataInsight by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8464

fix(ui): redirect to sign-in when user is not authorised by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8512

Fix #8517 - Move logging to DEBUG by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8519

Feat: Added pipeline as edge from ui by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8503

Add: databricks troubleshoot page by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/8523

Fix: Filter Databricks history by date by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/8520

(UI) #7790 : Added support to preserve search text for users and admins list page by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/8478

feat: add SageMaker connector by @techytushar in https://github.com/open-metadata/OpenMetadata/pull/8435

Fixed: dagster to connect to cloud by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/8387

Add Queued Status in Ingestion Pipelines by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8529

Fix #8490 Wrong message in the required message on Policy page by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8522

Fix mysql migration script syntax by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8536

Fix data insight Json Schema filename and content by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8534

Fix Dagster migration script by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8539

Cleaning up code warnings by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8532

Updated the document for docker deployment by @Vj-L in https://github.com/open-metadata/OpenMetadata/pull/8527

Docs best practices by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8541

Docs - Run connectors from MWAA by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8548

Feat UI: Added Tracing for lineage and Column lineage by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8542

Fix #7737 (UI) : Changed how entity details are shown in 'My Data' and 'Following' tabs on user details page by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/8524

Fix(UI) #8552: Fixed issue with tag removal for columns by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/8557

Schedule security scan every Monday at midnight by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8558

Fixes #8470 - Implements refinement functions for web analytics events by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8528

Fix(UI) #8563: Fixed field name in announcement modal. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/8564

Fix #8540 Session ID does not reset for web analytic by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8562

Fix #8455: fix dbt test errors when run not passed by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8545

schema-filter-added-in-datalake-for-bucket by @codingwithabhi in https://github.com/open-metadata/OpenMetadata/pull/8516

UI: Updated lineage UI as per new mock by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8568

Fix #8495: Update pipeline sources for pipeline as edge lineage by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8556

Fix #8481 (UI): Changed how team assets are shown similar to explore page by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/8526

UI: Fixed Data is getting round off at the time of formatting in en-US by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8576

feat: add QuickSight connector by @michizhou in https://github.com/open-metadata/OpenMetadata/pull/8442

Fixes #8432 - Added bit -> binary column type conversion for mssql by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8581

Fix: Hive connection issue by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/8583

Fixes 8470 -- Implements ES aggregation for web analytic data by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8566

Bump loader-utils from 1.4.0 to 1.4.1 in /openmetadata-ui/src/main/resources/ui by @dependabot in https://github.com/open-metadata/OpenMetadata/pull/8578

Feat(UI): Added EntitySummaryPanel in Explore page by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/8591

Fix #8570: Parsing Workflow Gracefully on Deploy by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8585

Feat kpis by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8584

Feat: UI Added feature to show edge information onClick of edge by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8599

WIP: Fixed amundsen ingestion by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/8544

Feat ✨ ( #8161) Implement logic to fetch report data part-1 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8499

feat(ui): update pipeline status UI by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8253

added docs for DOMO by @meet1999-cloud in https://github.com/open-metadata/OpenMetadata/pull/8543

Test workflow permissions by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8611

Test workflow permissions fix syntax by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8613

Fix java checkstyle permissions by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8614

Test Java checkstyle PR write permissions by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8615

Test Java checkstyle pull request write by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8616

Add approval CI workflow by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8620

Java checkstyle add missing ref by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8622

Bump bind9 bullseye version for ingestion container by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8619

Fix typo in KPI json schema by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8629

Fixed: Changed logic for parsing version by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/8606

Feat: Added Search functionality for lineage by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8609

Fix #8600: Add SQL query in lineage by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8603

Add permissions and approval flow for CI by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8625

Fix Workflows approval permissions by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8636

Remove approval check by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8637

Emailing Task and Test Notification by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8626

Feat✨ (#8161) Implement logic to fetch report data part-2 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8605

CI - Add PR approval wait for outside contributors by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8640

Fixes #8135 - Implement partitioning config for profiler by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8623

Revert "CI - Add PR approval wait for outside contributors" by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8644

Add maven CI permissions by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8646

Fix(UI): Explore page bugs by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/8607

Fix(UI) #8549: Fixed issue with URL in the description breaking due to characters limit. by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/8604

(UI) #8513: UI improvements - part 1 by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/8647

Feat #8639 UI : Show charts latest value in data insight overview card and rename datasets to data assets by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8641

fix(ui): pipelineDetails page update by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8582

Fixes #8596 Introduce mutually exclusive tags and glossary terms by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8597

cast to bigint to avoid overflow when summing by @sfirke in https://github.com/open-metadata/OpenMetadata/pull/8655

Fixes #8473 - Implements KPI Workflow by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8657

Feat: Added functionality to connect node by dragging and dropping from anywhere on node by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8631

Fix #8642 Session ID is not unique across users by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8660

Added MetadataServices for creating DataInsight and ElasticSearch Reindex by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8565

Fix py-cli-e2e-tests by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8662

Fix #8651: Fix Hive Table Descriptions by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8652

Fix#8577: Refactor part of the secrets manager implementation by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8617

Fix Mysql bigint by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8665

Add Workflow label verification for CI by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8653

Fix:#8553 Parse Avro/Protobuf/Json schemas by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/8654

CI - Do not check labels on push by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8672

Changed format for s3 staging by @NiharDoshi99 in https://github.com/open-metadata/OpenMetadata/pull/8632

python fix circular import by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8670

Fix(UI)#8627: Fixed tour flow failing on step 4 by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/8667

Fix(UI)#8659: Fixed issue with wrong link for custom attributes in activity feed by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/8668

Fixes #8506 Build tag and glossary term cache and use it instead of d… by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8686

Fixed Add Partition Setting in UI for Profiler #8624 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8673

Simplify EntityRepository store method by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8690

Fixes #8688 Enforce mutuallyExclusive tag labels by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8689

Ingestion Pipeline deployed, Athena tests and pydantic extras by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8682

Added pipelineTypes by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8692

Fix: Filter Datalake empty files by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/8677

Fix #8416: Restore Entities after soft delete with all it's old data by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8635

small letter was corrected on features by @YaYa-Ntlahla in https://github.com/open-metadata/OpenMetadata/pull/8691

Docs #8501: Added 0.12 to 0.13 upgrade docs by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8502

Add restore method for metadata resource by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8695

Fix PyMSSQL Version by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8696

Add queries in sample data for lineage by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/8674

Removed User and Test Suite by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8699

Fix : Types import issue for JwtAuth and SsoServiceType by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8702

Fix #8709: Added lineage workflow docs by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/8710

Fixed Lineage SQL query only visible on click #8628 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8697

UI: Fixed UI | Table Detail pane on the Lineage tab doesn't show the column count by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8711

chore(ui): explore page filter updates by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8580

Updated cypress code and fixed flaky cypress by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8666

Fix#8577: Services sensitive passwords fields are stored in secrets store by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8671

Change GET APIs to PUT apis by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8693

Mapping from kpi to dichart(One to one) by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8707

UI Fixed Deleting the Tier tag category causes UI errors #5849 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8703

Fix#8577: Bots sensitive passwords fields are stored in secrets store by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8720

fix(ui): update default status to empty instead queued by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/8716

UI : Changes the Payload while revoke token in Bot by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8715

UI :- Added restore option for soft deleted Entities by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8292

Added support for 'Metadata Services' connectors by @aniketkatkar97 in https://github.com/open-metadata/OpenMetadata/pull/8679

Feat ✨ (#8608) UI : Add KPIs support for data insight by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8645

UI : Added Password viewer on DBT fields by @Ashish8689 in https://github.com/open-metadata/OpenMetadata/pull/8724

ES reindex Airflow workflow by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8723

Fixes #8730 Backend - Support renaming tag category and tag names by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8731

Fixes #7524 Backend: Allow users to rename the Glossary name and Glos… by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/8734

Fix OM_DATABASE env variable name by @harshach in https://github.com/open-metadata/OpenMetadata/pull/8743

Data insight workflow by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8729

Fix#8577: Ingestion Pipelines sensitive passwords fields are stored in secrets store by @nahuelverdugo in https://github.com/open-metadata/OpenMetadata/pull/8725

Fix Delete API failure issue by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8747

updated feign verison in openmetadata-java-client by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/8758

reverting the version change by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/8762

fix: Run Maven CI on JSON Schema Changes by @akash-jain-10 in https://github.com/open-metadata/OpenMetadata/pull/8748

UI: Fixed Selection option for new node is not visible issue by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/8751

UI : Update the navbar items with new placeholder text by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/8756

Fixes the index not found issue on data insight page in case workflow is not run or created by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8770

Fixes Backend : KPI patch API is not working #8774 by @mohityadav766 in https://github.com/open-metadata/OpenMetadata/pull/8776

Dl Profiler by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/8694

Fix data insight bugs by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8761

New Contributors

@shivamshrey made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8139

@u7283219 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8156

@finn-mcclusky made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8183

@meet1999-cloud made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8222

@alancmag made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8297

@ssandy83 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8305

@MaheshGPai made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8320

@katebmckay made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8328

@javamultiplex made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8365

@amymareemc made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8334

@ShajithaMohammed made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8414

@Youssef1313 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8423

@rahulsurwade made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8085

@clueless-bot made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8456

@techytushar made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8452

@mihirk11 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8103

@michizhou made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8442

@YaYa-Ntlahla made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/8691

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.12.2-release...0.13.0-preview
Source code(tar.gz)
Source code(zip)
docker-compose-postgres.yml(7.88 KB)
docker-compose.yml(7.82 KB)
openmetadata-0.13.0-preview.tar.gz(94.13 MB)
0.12.2-release(Oct 20, 2022)
What's Changed

Cherry-pick Ingestion commits to 0.12.2 by @MilanBariya in https://github.com/open-metadata/OpenMetadata/pull/8275

0.12.2 - Airflow Managed Apis - Support Airflow 2.2.2 by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8278

Tag PATCH + Cleanup of helpers methods (#8150) by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/8274

Cherry Pick "Fix test suite bug for redefined quotes (#8248)" for 0.12.2 by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/8280

New release 0.12.2 by @Vj-L in https://github.com/open-metadata/OpenMetadata/pull/8285

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.12.2-preview...0.12.2-release
Source code(tar.gz)
Source code(zip)
docker-compose-postgres.yml(7.85 KB)
docker-compose.yml(7.79 KB)
openmetadata-0.12.2.tar.gz(87.50 MB)
0.12.2-preview(Oct 13, 2022)

TBD - Preview Release
Source code(tar.gz)
Source code(zip)
docker-compose-postgres.yml(7.82 KB)
docker-compose.yml(7.76 KB)
openmetadata-0.12.2-preview.tar.gz(87.50 MB)
0.12.1-release(Oct 3, 2022)
0.12.1 Release

Basic Authentication

User/Password signup and login

Email notifications for forgotten password

Admin can add new users and send an email

ElasticSearch full-index through UI

Now admins can full-re index elasticsearch through the UI itself

Versioning support for Custom Attributes

Any changes to entity custom attributes are now versioned

DBT Metadata - Tags

We support ingesting DBT tags into OpenMetadata

Bots Integration

Admins can create bots and their security mechanism from UI itself.

Bug Fixes

Around 136 Features/Bug fixes/improvements/Tests made it into 0.12.1 release

New Contributors

@Rounak-28 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/7212

@sivaarumalla made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/7529

@Ashok810 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/7628

@mavimo made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/7689

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.12.0-release...0.12.1-release
Source code(tar.gz)
Source code(zip)
docker-compose-postgres.yml(7.43 KB)
docker-compose.yml(7.38 KB)
openmetadata-0.12.1.tar.gz(118.19 MB)
0.12.0-release(Sep 8, 2022)
0.12.0 Release - Sept 7th 2022 🎉

You can read the Release Blog here or watch an awesome video showing the new features!

Team Hierarchy

Prior releases supported a flat hierarchy of just Teams and Users. In 0.12, support has been added for the entire organizational hierarchy with Business Unit, Division, Department, and Groups. An organization from small to very large can now be modeled in OpenMetadata with this feature.

Roles and Policies

Access Control functionality has been revamped to support many use cases that were not possible before. Previously, a Role contained a single Policy, which consisted of simple Rules to Allow/Not Allow. The advanced rule configuration in the 0.12 release allows users to build more expressive rules using conditions.

A Role is a collection of Policies. Roles can be assigned to users or teams where all the users in the team inherit the team roles.

A Policy is a collection of Rules. A Policy can be reused as it can be part of a Role or can be directly assigned to Teams.

A Rule is defined by a set of Resources, a set of Operations, an Effect to either Deny or Allow the operation, and a condition written as SpEL expression to add additional conditions based on metadata attributes. Examples of conditions — isOwner(), noOwner() && !matchTags('PII').

Data Quality and Data Profiler

OpenMetadata began support for Data Quality in the 0.10 release, and support was added for publishing Great Expectations results in the 0.11 release. Our goal with OpenMetadata is to define metadata standards for all things data and in this release, we are standardizing Tests and Data Quality metadata. Data Quality Tests can be expressed in JSON schema and now these tests can be added dynamically using the Test Definitions API. We have also added a custom SQL data quality test that allows you to write your data quality tests using SQL statements.

An interactive dashboard helps to visualize and explore the data from the Data Profiler. You can explore how your data is changing over time, and identify data drifts using this dashboard. You can also see how data quality is changing by looking at how tests are doing over time. What is even better is, that you can explore this at both the table level or drill down to each column level going back up to 60 days.

The UI supports the detailed exploration of data quality tests, and users can drill down for the details of the test results present in a time series fashion. Tests can be added easily from the Profiler tab in the UI, both at the Table and Column levels. The UI provides a one-glance update on the metrics with a summary of data quality at the Table and Column levels.

Announcements

Informing users about upcoming changes to the data is a big challenge. In most organizations, a team sends an email well in advance about the change. But no one reads/tracks them and finally, when the change is done, many users are unprepared to handle it.

With Announcements, you can now inform your entire team of all the upcoming events and changes, such as deprecation, deletion, or schema changes. These announcements can be scheduled with a start date and an end date. All the users following your data are not only notified in Activity Feeds but a banner is also shown on the data asset details page for users to discover (or be reminded of) the announcement.

Activity Feed Notifications

In 0.12, we’ve also streamlined the Notifications menu with two separate tabs for Tasks and Mentions, that’ll display only the recent notifications. You can always navigate to your User Profile page to view more activities.

Slack & Microsoft Teams integration

Users can get timely updates about the metadata change events for all entities through APIs using webhooks. The webhook integration with Slack has been further improved in this release.

OpenMetadata also supports webhook integration to Microsoft Teams, just as it supports Slack. Users can choose to receive notifications for only the required entities by using event filters based on when an entity is created, updated, or deleted.

Tasks

In the 0.11 release, a request to add or update descriptions for data assets could be converted to a Task. In the 0.12 release, Tasks can be created based on requests to create or update tags. Also, a glossary term approval workflow can be converted to a Task.

Secret Management Store Interface

In 0.12, we have completely revamped how that secret is stored, accessed, and by whom; by introducing a Secrets Manager Interface to communicate with any Key Management Store. The KMS will mediate between any OpenMetadata internal requirement and sensitive information. That way, users can choose to use the underlying database as KMS, or any external system. The OpenMetadata community has already added support for AWS Key Management Service and AWS SSM.

Connectors

New connectors are an essential part of every release in OpenMetadata. We are introducing four new connectors in this release:

Redpanda is a Kafka API-compatible streaming data platform for developers that unifies historical and real-time data. OpenMetadata now supports Redpanda as a Messaging service, which allows users to document its topics and schemas. Refer to the Redpanda documentation for more info.

Dagster is a new-generation Python-based orchestrator that’s designed for developing and maintaining data assets, such as tables, data sets, machine learning models, and reports. It has been added as part of OpenMetadata’s pipeline connectors. Read more from the Dagster documentation.

Fivetran delivers ready-to-use connectors that automatically adapt as schemas and APIs change, ensuring consistent, reliable access to data. It has been added as a pipeline service. For more information, refer to the Fivetran documentation.

Apache NiFi automates the flow of data between systems. OpenMetadata now supports a NiFi connector as the third new pipeline service on this release.

Lineage

We’ve enhanced the performance of workflows by having a separate workflow for Lineage and Usage. By using two workflows for computing specific pieces of information, we can effectively filter down the queries to extract lineage.

During table usage ingestion, the tables retrieved successfully will be cached, so that there is no need to repeat the same calls multiple times as many queries would be referencing the same tables. Usage queries have been optimized. A result limit has been added to Usage queries.

Global Settings

The OpenMetadata Settings dropdown menu has been transformed into a single, centralized Settings page for added convenience in viewing all the available options. The Global Settings comprises setting options for Team Members, Access based on Roles and Policies, Services, Data Quality, Collaboration, Custom Attributes, and Integrations for webhooks and bots. Admins can view or update settings for various services like Slack, MS Teams, Webhooks, etc from the Global Settings page.

UI/UX Improvements

The major UI UX improvements have been done around Roles and Policies and a Global Settings page. Quite a lot of tweaks have been made to the UI to improve the UX.

When creating a new user or when a user is registering for the first time, the dropdown menu for Teams now displays an option to ‘Show All’ teams. Previously, we supported the display of only the first 10 teams. An option has also been provided to search and filter. UI improvements have been made on the Schema, Service, and Database details pages. Manage Tab has been replaced with the manage button on the UI.

New Contributors

@eitsupi made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/5818

@truemanD made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/5819

@nna077 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/5821

@restnek made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/6222

@psg2 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/6257

@k-popov made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/6403

@dependabot made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/6461

@aniketkatkar97 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/6471

@ShilpaVernekar made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/6611

@rameeshm made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/6625

@luanpaschoal made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/6722

@NiharDoshi99 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/6649

@cristiancalugaru made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/6877

@Ashish8689 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/6986

@Damon-Zeng made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/7015

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.11.0-release...0.12.0-release
Source code(tar.gz)
Source code(zip)
docker-compose-postgres.yml(6.79 KB)
docker-compose.yml(6.68 KB)
openmetadata-0.12.0.tar.gz(112.81 MB)
0.11.5-release(Aug 23, 2022)
What's Changed

cherry-pick(ui): teams & azure auth fixes by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/6520

fix(ui): Update flags from AuthProvider only (#6566) by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/6569

fix(ui): oidc login stuck at loading (#6597) by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/6599

Oracle Client Lib issue fix by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/6648

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.11.4-release...0.11.5-release
Source code(tar.gz)
Source code(zip)
docker-compose.yml(5.48 KB)
openmetadata-0.11.5.tar.gz(87.66 MB)
openmetadata-airflow-apis-plugins.tar.gz(3.05 KB)
0.11.4-release(Aug 1, 2022)
What's Changed

Metabase cherry pick by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/6383

Cherry-Pick Ingestion Commits to 0.11.4 by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/6467

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.11.3-release...0.11.4-release
Source code(tar.gz)
Source code(zip)
docker-compose.yml(5.48 KB)
openmetadata-0.11.4.tar.gz(86.71 MB)
openmetadata-airflow-apis-plugins.tar.gz(3.05 KB)
0.11.3-release(Jul 27, 2022)
What's Changed

Cherry pick issues by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/6217

Fix softDelete should not sent hardDelete true (#6226) by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/6227

redirect to home only if loggedIn flag updates by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/6297

fix(ui): infinite load over login first time by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/6319

UI cherry pick by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/6372

Fix json2ts build errors (#6332) by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/6373

Fix open-metadata#5890 - Add health endpoint (open-metadata#6030)

[ISSUE-6162] Upgrade RS SQL statement query (open-metadata#6188)

[ISSUE-6162] Escape wildcards on revised RS query (open-metadata#6200)

Remove retry in ES query (open-metadata#6191)

Fix open-metadata#6161 - kill endpoint for Airflow REST (open-metadata#6244)

Fixes open-metadata#6031 & open-metadata#6236 -- Handle binary field & UUID when ingesting sample data (open-metadata#6233)

overwrite default sum function to add super for BQ overflow (open-metadata#6252)

[TASK-6241] Cache ES ingestion when ingesting usage (open-metadata#6276)

[TASK-6140] Add OMeta header to SQLAlchemy-based queries (open-metadata#6293)

Fix open-metadata#6248: Use PUT API instead of POST for tag & tagCategory (open-metadata#6344)

Airflow REST - Get last logs 404 (#6281) - Compressed logs

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.11.2-release...0.11.3-release
Source code(tar.gz)
Source code(zip)
docker-compose.yml(5.48 KB)
openmetadata-0.11.3.tar.gz(87.55 MB)
openmetadata-airflow-apis-plugins.tar.gz(3.05 KB)
0.11.2-release(Jul 19, 2022)
What's Changed

Cherry pick 02d3695d048cb3478d0df3b1a652442736f43d65 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/6007

UI cherry pick by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/6182

Fix #6061 Backend: Custom properties creation error (#6098) by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/6194

Fix #6179 Edge not getting generated when multiple tasks in pipeline(#6181) by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/6195

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.11.1-release...0.11.2-release
Source code(tar.gz)
Source code(zip)
docker-compose.yml(5.48 KB)
openmetadata-0.11.2.tar.gz(86.76 MB)
openmetadata-airflow-apis-plugins.tar.gz(3.05 KB)
0.11.1-release(Jul 11, 2022)
What's Changed

Prepare postgres migrations by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/5814

Fixed: Team & Users page is stuck at loading on trying to join the team by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/5816

Fix typo by @eitsupi in https://github.com/open-metadata/OpenMetadata/pull/5818

Defined a constant instead of duplicating string literal #1982 by @truemanD in https://github.com/open-metadata/OpenMetadata/pull/5819

Refactor code to consolidate common code to EntityRepository and clea… by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/5824

Fix #5826 UI : Add Error Boundaries by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/5827

Fix #5532 Suppress Yaml Warnings for generate typescript command by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/5783

Fixes #5558 Add support for enumerating Operations and Resources for authoring policies by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/5561

Added event error and fernet classes to openmetadata-core by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/5799

Fix#5843 UI : Do not show the request description icon in entities that has no support for tasks yet by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/5844

added condition to echo only with debug flag in bootstrap.sh by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/5845

Cypress: Cover service page issue related to description by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/5529

[Fix] Removed volume instructions from dockerfile. by @Rabi-Sahoo in https://github.com/open-metadata/OpenMetadata/pull/5851

chore(ui): update types with respective libs instead hardcoded by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/5848

Fixes #5245 Entity tag is not getting removed, even after glossary te… by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/5838

Fix #5471 Creating a tag with an illegal character prevents utilizing the tagging system until manually removed by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/5854

Fix: issue 5645: UI feedback 0.11 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/5853

Fixed Column level lineage issue #5825 by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/5861

fix(ui): #5836 User profile should show user related activity only by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/5864

Fix #2895: Added Foreign Key support by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/5856

added config to publish to maven repository in catalog pom.xml by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/5870

Fixes #3133 -- Adding Additional Column Tests by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/5867

Fix #5871 - Validate rest and update FQN for DatabaseSchema by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/5873

Feat: UI button to pause/unpause ingestion pipeline executions by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/5884

issue-5757: s3-prefix-fix-added by @codingwithabhi in https://github.com/open-metadata/OpenMetadata/pull/5876

fix(ui): #5850 loading issue for teams and user page by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/5881

Feat: Added Lineage support for topic and mlModal by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/5888

Fixes #5866 -- Implement Support for Median Metric by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/5887

Fix #5764 Backend: Add support for filter by task status by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/5899

Fix #5857 Add icon for foreign key constraint by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/5904

UI: Fix browser zoom breaks UI layout by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/5909

revert(ui): count badge was limit to 999 by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/5910

test(ui): unit tests added for profilerUtils by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/5922

Update docs recipe by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/5886

Dbt Fixes and removed urllib from DBT and ometa by @OnkarVO7 in https://github.com/open-metadata/OpenMetadata/pull/5928

fixed issue: Error handling not present for add/delete/update Webhook by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/5911

✨ UI: Display a switch to show Closed Tasks vs Open Tasks by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/5929

Update python CI order by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/5934

fix(ui): owner search issue and show total count on load by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/5932

Fix metadata es DAG by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/5933

Fix Authentication Public Keys env variable in docker compose by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/5948

Fix #5877: Renamed Database to DatabaseSchema for Oracle Connection by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/5889

Fix #5905: Bootsrap Migration Fix by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/5930

Fix #5926 Missing downstream in pipeline task view by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/5950

Fix inputvariables by @Vj-L in https://github.com/open-metadata/OpenMetadata/pull/5961

Prepare OpenMetadata Main for Next Release by @Vj-L in https://github.com/open-metadata/OpenMetadata/pull/5962

feat(ui): refresh token support for OIDC client login by @chirag-madlani in https://github.com/open-metadata/OpenMetadata/pull/5923

Fix #5809 Show count of schemas and tables being deleted when a database service is being deleted. by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/5963

Fixes #5964 -- Trino Median function and columnValuesToMatchRegex wording by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/5965

Update missing FQN by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/5966

Fix issue 5955 non-joinable team also visible at the time of signup by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/5957

Fix #5956 Long team names go out of the box by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/5959

Fix #5968 Airbyte logo is missing by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/5970

Connection options fix by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/5971

Snowflake View Definition Fix by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/5974

Docs - Migrate overview and restructure menu by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/5983

Fixed #2188: Can add and remove more than 10 tags at once. by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/5040

Docs migration - Deployment and upgrades by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/5984

Fix airflow docs by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/5985

Fix #5092: Allow tag names to be 64 chars in length by @harshach in https://github.com/open-metadata/OpenMetadata/pull/5986

Fixed issue-5897: UI: Tags usage link is broken by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/5975

Fix #5860: Dashboard usage throws Entity type not supported by @harshach in https://github.com/open-metadata/OpenMetadata/pull/5987

Fixed issue 5981 UI: Add Team button doesn't work in the users page by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/5992

Snowflake Password Optional Field by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/5994

Fix UI: User name overflows out of the profile dropdown by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/5993

New Contributors

@eitsupi made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/5818

@truemanD made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/5819

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.11.0-release...0.11.1-release
Source code(tar.gz)
Source code(zip)
docker-compose.yml(5.48 KB)
openmetadata-0.11.1.tar.gz(86.68 MB)
openmetadata-airflow-apis-plugins.tar.gz(3.05 KB)
0.11.0-release(Jun 30, 2022)

Data Collaboration - Tasks and Emojis

Data Collaboration has been the prime focus of the 0.11 Release, the groundwork for which has been laid in the past several releases. In the 0.9 release, we introduced Activity Feeds, Conversation Threads, and the ability to request descriptions. In this release, we’ve added Tasks, as an extension to the ability to create conversations and post replies. We are particularly excited about the ability to suggest tasks. This brings the collaboration to the next level where an organization can crowdsource the knowledge and continuously improve descriptions.

Column Level Lineage

https://github.com/open-metadata/OpenMetadata/issues/2931 In OpenMetadata, we primarily compute column-level lineage through SQL query analysis. Lineage information is consolidated from various sources, such as ETL pipelines, DBT, query analysis, and so on. In the backend, we’ve added column-level lineage API support. The UI now supports exploring this rich column-level lineage for understanding the relationship between tables and performing impact analysis. While exploring the lineage, users can manually edit both the table and column level lineage to capture any information that is not automatically surfaced.

Custom Properties

The key goal of the OpenMetadata project is to define Open Metadata Standards to make metadata centralized, easily shareable, and make tool interoperability easier. We take a schema-first approach for strongly typed metadata types and entities modeled using JSON schema as follows:

OpenMetadata now supports adding new types and extending entities when organizations need to capture custom metadata. New types and custom fields can be added to entities either using API or in OpenMetadata UI. This extensibility is based on JSON schema and hence has all the benefits of strong typing, rich constraints, documentation, and automatic validation similar to the core OpenMetadata schemas.

Advanced Search

Users can search by multiple parameters to narrow down the search results. Separate advanced search options are available for Tables, Topics, Dashboards, Pipelines, and ML Models. All these entities are searchable by common search options such as Owner, Tag, and Service.

Glossary UI Updates

The Glossary UI has been upgraded. However, the existing glossary functionality remains the same, with the ability to add Glossary, Terms, Tags, Descriptions, Reviewers etc... On the UI, the arrangement displaying the Summary, Related Terms, Synonyms, and References has been changed. The Reviewers are shown on the right panel with an option to add or remove existing reviewers.

Profiler and Data Quality Improvements

Profiling data and communicating quality across the organization is core to OpenMetadata. While numerous tools exist, they are often isolated and require users to navigate multiple interfaces. In OpenMetadata, these tests and data profiles are displayed alongside your assets (tables, views) and allow you to get a 360-degree view of your data.

Great Expectations Integration

While OpenMetadata allows you to set up and run data quality tests directly from the UI, we understand certain organizations already have their own data quality tool. That’s why we have developed a direct integration between Great Expectations and OpenMetadata. Using our openmetadata-ingestion[great-expectations] python submodule, you can now add custom actions to your Great Expectations checkpoints file that will automatically ingest your data quality test results into OpenMetadata at the end of your checkpoint file run.

ML Models

In this release, we are happy to share the addition of ML Model Entities to the UI. This will allow users to describe, and share models and their features as any other data asset. The UI support also includes the ingestion through the UI from MLflow. In future releases, we will add connectors to other popular ML platforms. This is just the beginning. We want to learn about the use cases from the community and connect with people that want to help us shape the vision and roadmap. Do not hesitate to reach out!

Connectors

In every release, OpenMetadata has maintained its focus on adding new connectors. In the 0.11 release, five new connectors have been added - Airbyte, Mode, AWS Data Lake, Google Cloud Data Lake, and Apache Pinot.
Source code(tar.gz)
Source code(zip)
docker-compose.yml(5.49 KB)
openmetadata-0.11.0.tar.gz(86.57 MB)
openmetadata-airflow-apis-plugins.tar.gz(3.05 KB)
0.10.4-release(Jun 21, 2022)

0.10.4 is a minor release with following fixes - #5303 #5468 #5459 #5500 #5543
Source code(tar.gz)
Source code(zip)
docker-compose.yml(5.54 KB)
openmetadata-0.10.4.tar.gz(83.48 MB)
openmetadata-airflow-apis-plugins.tar.gz(3.05 KB)
0.10.3-release(Jun 10, 2022)

0.10.3 is a minor release with following fixes #5070 #5203 #5224 #5275
Source code(tar.gz)
Source code(zip)
docker-compose.yml(5.54 KB)
openmetadata-0.10.3.tar.gz(83.48 MB)
openmetadata-airflow-apis-plugins.tar.gz(3.05 KB)
0.10.2-release(Jun 2, 2022)

0.10.2 is a minor release with following fixes #5148 #5256 #5267 #5272
Source code(tar.gz)
Source code(zip)
docker-compose.yml(5.18 KB)
openmetadata-0.10.2.tar.gz(83.48 MB)
openmetadata-airflow-apis-plugins.tar.gz(3.05 KB)
0.10.1-release(May 18, 2022)
What's Changed

Support for Postgres as OpenMetadata Store #4601

UI Improvements in 0.10.1 Release #4600

Support JWT Token Generation for Bot Accounts #4637

UI Ingestion Improvements - Support for Dashboards & Messaging Services #4843

Security: Fix Azure SSO and support refresh tokens (#4988) by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/4989

New Contributors

@cometta made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/2916

@snyk-bot made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3130

@Beetelbrox made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3185

@sfirke made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3361

@mosiac1 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3599

@troyel made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3695

@dvecerdea made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3800

@Curiosady made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3892

@barloc made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/4037

@Vj-L made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/4092

@TeraInferno made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3720

@vitoravancini made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/4733

@habibrhmn made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/4800

@filip-xmargin made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/4926

@mohitdeuex made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/4956

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.10.0-release...0.10.1-release
Source code(tar.gz)
Source code(zip)
docker-compose.yml(5.18 KB)
openmetadata-0.10.1.tar.gz(83.48 MB)
openmetadata-airflow-apis-plugins.tar.gz(3.05 KB)
0.10.0-release(Apr 26, 2022)
What's Changed

Support for Database Schema

OpenMetadata supports databases, service name databases, and tables. We’ve added Database Schema as part of the FQN. For each external data source, we ingest the database, as well as the tables that are contained underneath the schemas.

Support for Hard Delete

OpenMetadata supported soft deletions. Now, we also support the hard deletion of entities through the UI, APIs, and ingestion. Hard deleting an entity removes the entity and all of its relationships. This will also generate a change event.

Deploy Ingestion from UI

OpenMetadata has refactored the service connections to simplify the ingestion jobs from both the ingestion framework as well as the UI. We now use the pydantic models automatically generated from the JSON schemas for the connection definition. The ‘Add Service’ form is automatically generated in the UI based on the JSON schema specifications for the various connectors that are supported in OpenMetadata.

Download DBT Manifest Files from Amazon S3 or Google Cloud Storage

Previously, when ingesting the models and lineage from DBT, we passed the path of the DBT manifest and catalog files directly into the workflow. We’ve worked on improving the quality of life of DBT. Now, we can dynamically download these files from Amazon S3 or Google Cloud Storage. This way we can have any other process to connect to the DBT, extract the catalog, and put it into any cloud service. We just need the path name and workflow job details from the metadata extraction to be able to ingest metadata.

JSON Schema based Connection Definition

Each service (database, dashboard, messaging, or pipeline service) has its own configuration specifications, with some unique requirements for some services. Instead of the ad hoc definitions of the source module in Python for each connector, we’ve worked on the full refactoring of the ingestion framework. We now use the pydantic models automatically generated from the JSON schemas for the connection definition.

Airflow Rest APIs

The Airflow REST APIs have been refactored. With our API centric model, we are creating a custom airflow rest API directly on top of Airflow using plugins. This passes the connection information to automatically generate all the dags and prepares handy methods to help us test the connection to the source before creating the service.

UI Changes

The UI improvements are directed towards providing a consistent user experience.

Hard Deletion of Entities: With the support for the hard deletion of entities, we can permanently delete tables, topics, or services. When the entity is hard deleted, the entity and all its relationships are removed. This generates an ‘EntityDeleted’ change event.

Dynamic “Add Service” Forms: The ‘Add Service’ form is automatically generated in the UI based on the JSON schema specifications for the various connectors that are supported in OpenMetadata.

UI Support for Database Schema as part of FQN: The database schema has been introduced in the 0.10 release. All the entity pages now support Database Schema in the UI.

Lineage Editor: Improvements have been made to the lineage editor.

Teams: While signing up in OpenMetadata, the teams with restricted access are hidden and only the joinable teams are displayed.

Team Owner: An Owner field has been added to the Team entity. Only team owners can update the teams.

Activity Feeds: The Activity Feeds UI supports infinite scrolling.

Add User: A user can be added from the Users page.

Security Changes

Support Refresh Tokens for Auth0 and Okta SSO

The JWT tokens generated by the SSO providers expire by default in about an hour, making the user re-login often. In this release, we’ve added support for refresh tokens for Auth0 and Okta SSO. The tokens are refreshed silently behind the scenes to provide an uninterrupted user experience. In the future releases, we’ll continue to stabilize authentication and add refresh tokens for the other SSO providers.

Custom OIDC SSO

OpenMetadata now supports integration with your custom built OIDC SSO for authentication. This is supported both on the front end for user authentication as well as on the ingestion side.

Azure SSO

Support has been added for Azure SSO on Airflow.

New Contributors

@cometta made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/2916

@Beetelbrox made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3185

@sfirke made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3361

@OnkarVO7 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3408

@mosiac1 made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3599

@troyel made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3695

@dvecerdea made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3800

@Curiosady made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3892

@MilanBariya made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3949

@barloc made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/4037

@Vj-L made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/4092

@TeraInferno made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3720

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.8.1-release...0.10.0-release
Source code(tar.gz)
Source code(zip)
docker-compose.yml(5.18 KB)
openmetadata-0.10.0.tar.gz(82.03 MB)
openmetadata-airflow-apis-plugins.tar.gz(3.06 KB)
0.9.1-release(Apr 8, 2022)
Collaboration

Conversations in the main feed

Users can ask each other questions, add suggestions and replies

Table details - Click through on usage to see who or what services are using it, and what queries are pulling from it.

Data Quality

Ability to create and monitor the test cases

Data Quality Tests support with Json Schemas and APIs

UI Integration to enable users to write tests and run them on Airflow

Glossary

Glossaries are a Controlled Vocabulary in an organization used to define the concepts and terminologies specific to a particular domain.

API & Schemas to support Glossary

UI support to add Glossary and Glossary Terms.

Support for using Glossary terms to annotate Entities and Search using Glossary Terms

Connectors

Apache Iceberg

Azure SQL

Clickhouse

Clickhouse Usage

Databricks

Databricks Usage

Delta Lake

DynamoDB

IBM DB2

Power BI

MSSQL Usage

SingleStore

Apache Atlas, Import Metadata from Apache Atlas into OpenMetadata

Amundsen, Import Metadata from Amundsen into OpenMetadata

Lineage

DataSource SQL Parsing support to extract Lineage

View Lineage support

Pipeline

Capture pipeline status as it happens

Security

Security policies through the UI

Configuration personas and authorization based on policies

AWS SSO support

New Contributors

@cometta made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/2916

@Beetelbrox made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3185

@sfirke made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3361

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.8.1-release...0.9.1-release
Source code(tar.gz)
Source code(zip)
openmetadata-0.9.1.tar.gz(79.50 MB)
0.9.0-release(Mar 10, 2022)
What's Changed

Handle description and tag updates NPE by @harshach in https://github.com/open-metadata/OpenMetadata/pull/2856

Generating Typescript Types from Json Schema. by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/2851

Fix #2835, #2836 Lineage entities overlap and Descriptions in Lineage view do not have formatting. by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/2840

Fix #2778 UI : Add Queries tab for table details page. by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/2793

Fix: #2521 - Add owner support for all services and database by @darth-coder00 in https://github.com/open-metadata/OpenMetadata/pull/2858

Tableau Lineage Implementation by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/2850

Table Constraints Added - Ingestion by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/2854

Add support for default role (#2631) by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/2676

Fix #2837: Add a Feed Count API with entityLink filter support by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/2860

Fix #2845 - Init Profiler Workflow by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/2862

Fix access control rule userRoleAttr to point to roleName by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/2644

Support swapping default roles by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/2868

Extend team to support defaultRoles by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/2885

fix: cherry pick for 0.8.3 by @akash-jain-10 in https://github.com/open-metadata/OpenMetadata/pull/2893

fix #2869: snowflake-usage processor fixed by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/2896

Fix #2902 - Check for empty payload by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/2903

Fix #2867: Add support for GET /feed/{id} by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/2892

Fix #2894 - Profiler Processor & Metrics by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/2900

Fix : Roles page is showing blank UI when switching to the users tab. by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/2922

fix incorrect query by @cometta in https://github.com/open-metadata/OpenMetadata/pull/2916

Fix #2890 Show columns icons in Lineage UI enhancement. by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/2924

Fix #2901: fixed error message by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/2917

Removed ColumnDataTypeDisplay check with ColumnDataType by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/2928

Fix #2871: Make search magnifying glass clickable to search by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/2923

Fixes #2899 - Not getting proper relation between parent and child gl… by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/2941

Fix #2953: NoopAuthorizer should create a anonymous user by @harshach in https://github.com/open-metadata/OpenMetadata/pull/2940

Changing selenium version by @kshinde2512 in https://github.com/open-metadata/OpenMetadata/pull/2934

Added Error Handling in Policy tags - Bigquery by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/2933

Fix #2905: Added MSSQL Usage Connector by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/2948

Refactor EntityReference list population with id list for a given entity type by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/2956

Fix #2865: Thread should have its own message and posts should only be the replies by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/2944

Support returning teams for GET /roles by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/2958

Fixes #2942 - Fix bugs reported by Sonar issue on release 0.9 by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/2943

Fix #2878 & #2877 - Implement Metrics and Validate Composed Metrics by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/2926

Bigquery lineage mapping by @codingwithabhi in https://github.com/open-metadata/OpenMetadata/pull/2849

Fix #2897 - Profiler CLI by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/2967

Fix #2873: DataQuality test specifications and APIs by @harshach in https://github.com/open-metadata/OpenMetadata/pull/2906

fix: Bump up release version 0.8.4 for docker compose by @akash-jain-10 in https://github.com/open-metadata/OpenMetadata/pull/2968

Fix #2539: redshift lineage mapping by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/2828

Adding Webhooks selenium tests by @kshinde2512 in https://github.com/open-metadata/OpenMetadata/pull/2911

Assign default roles from Teams to User by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/2947

Fix #2966: JWT filter should compare times in UTC to check the validity by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/2971

Update all *.java in openmetadata-ui to use lombok.LOG by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/2973

Use RequiredArgsConstructor in openmetadata-ui/*.java by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/2974

fix #2809: Auto populate View Lineage to Tables by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/2977

Fix #2965 - Additional Properties set to False by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/2976

Use lombok Getter to simplify openmetadata-ui/*.java files by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/2975

Fix #2981 - Update Profile to match TableProfile by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/2982

Fix #2991: Add ES support for glossary by @harshach in https://github.com/open-metadata/OpenMetadata/pull/2993

Fixes #2962 - Clean up fields parameter choices in GET APIs by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/2963

Fix #2946: Presto Ingestion issues fix by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/2986

Fix #2937: added clickhouse usage connector by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/2987

Fix Okta Authentication and Validation - Ingestion by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/2955

Fix #2996: ChangeEventHandler throws NPE at times by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/2998

Metabase lineage by @codingwithabhi in https://github.com/open-metadata/OpenMetadata/pull/3003

Fix #2834: Merge the change events 'delete' and 'add' as 'update' for Activity Feed by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/3006

updated chrome drivers and added options for headless chrome by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/3009

Fix #2807: Merge openmetadata.yaml and openmetadata-server.yaml by @harshach in https://github.com/open-metadata/OpenMetadata/pull/2808

Fix #3012 - Dependency breaking Airflow Container by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3015

Fix: #2938 Remove serviceType from service UI route by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/2939

Feat collaboration by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/2859

Fix #2984: added azure sso auth by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/3002

Fixes #3021 - Restore a soft-deleted container entity along with the … by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/3022

Fixes #3007 - Clean up Sonar flagged issues by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/3008

Fix #3023: Keep ElasticSearch version to 7.13 by @harshach in https://github.com/open-metadata/OpenMetadata/pull/3024

Power BI connector by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/3019

Feat : Display a chat icon next to data entities that have threads by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3026

Atlas connector by @codingwithabhi in https://github.com/open-metadata/OpenMetadata/pull/2855

ES index: ignore any errors during the es index by @harshach in https://github.com/open-metadata/OpenMetadata/pull/1220

WIP - Selenium fix by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/3014

Fix #3037: metadata --version doesn't work by @amiorin in https://github.com/open-metadata/OpenMetadata/pull/3038

Fix #3040 - py_format recipe includes more paths by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3043

Fix: #2491 - improvements in google, okta and azure auth by @darth-coder00 in https://github.com/open-metadata/OpenMetadata/pull/2929

fix #3035: handled none entity by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/3036

Add UpdateTeam permission support by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/2994

Fix #3041: Handled AttributeError by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/3042

Fix: azure auth callback from UI by @darth-coder00 in https://github.com/open-metadata/OpenMetadata/pull/3048

Fix #2989: Add delete apis for tests by @harshach in https://github.com/open-metadata/OpenMetadata/pull/3020

Fix #3047: OpenMetadata Server fails to run when updating config from Environment variable by @harshach in https://github.com/open-metadata/OpenMetadata/pull/3049

Fix #2866: Add support for PATCH to feed API to be able to resolve a thread by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/3027

Fix #3051: Glossary-term suggest api has fqdn same as name by @harshach in https://github.com/open-metadata/OpenMetadata/pull/3052

Feat: UI Add Support for @ and # in text editor by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3017

Simplify default role allocation for users by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/3061

added skip config for ui build-check by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/3030

Fixes #3069 - Add PATCH support Glossary and GlossaryTerms by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/3070

Clean up System.out.println and bump up ingestion-core version by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/3072

Fix: restricted actions in insecure mode by @darth-coder00 in https://github.com/open-metadata/OpenMetadata/pull/3073

Fix #2875 - Profiler API Sink by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3011

Fixes #3069 - Attempt 2 - Add PATCH support Glossary and GlossaryTerms by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/3088

adding config for ui tests by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/3082

Fix #3067: Service Creation should only be done by Bots or admins and Update only by the owners by @harshach in https://github.com/open-metadata/OpenMetadata/pull/3068

fix #3077: Fixed validation error in ldap by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/3079

Excluding db2 from all plugins by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/3097

Fix google auth by @darth-coder00 in https://github.com/open-metadata/OpenMetadata/pull/3096

Fix #3028: Add filter support for Feed API by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/3093

Sql_alchemy_helper Engine fix by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/3116

Redshift-table-name-fail-fix-in-query by @codingwithabhi in https://github.com/open-metadata/OpenMetadata/pull/3114

Fixes #3125 Upgrade dependencies to address security vulnerabilities by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/3132

Fix #3080: Activity Feed: Blank feed on my-data page for updating user's role or team by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/3131

Fix #3084 - Implement missing tests by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3117

Publish mvn test report to PR by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/3086

[Snyk] Fix for 3 vulnerabilities by @snyk-bot in https://github.com/open-metadata/OpenMetadata/pull/3130

Publish mvn test report to PR by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/3135

[Snyk] Security upgrade python from 3.8 to 3.8.12-slim-buster by @snyk-bot in https://github.com/open-metadata/OpenMetadata/pull/3134

Generate typescript types from json schema. by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3136

Selenium tests issue fix by @kshinde2512 in https://github.com/open-metadata/OpenMetadata/pull/3010

column-issue-fixed by @codingwithabhi in https://github.com/open-metadata/OpenMetadata/pull/3138

Fix #3140 UI Allow users to update teams based on updateTeams permission. by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3141

Fix #3112 - col profile safety & sample data by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3142

Fix #2874Support ability to select a role as default from the UI by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3145

Fix #2884 UI From Roles page, Admin should be able to assign the role to a team by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3147

Fix #3105 - ColumnValuesToMatchRegex & other fixes by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3149

Fix: Query Parser by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/3154

fix ISSUE-3137: updated-redash-library-and-function by @codingwithabhi in https://github.com/open-metadata/OpenMetadata/pull/3157

Fix #3066: Superset Auth Fixed by @ulixius9 in https://github.com/open-metadata/OpenMetadata/pull/3156

[Snyk] Security upgrade ubuntu from 16.04 to xenial-20210416 by @snyk-bot in https://github.com/open-metadata/OpenMetadata/pull/3126

Fix #3046 UI Add support for request description by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3074

Fix role entity not found in NoopAuthorizer by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/3159

Clean up json-schema ids by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/3164

Fix entity not found in Authorizer init by @mithmatt in https://github.com/open-metadata/OpenMetadata/pull/3177

Fix #3181 - Align ingestion requirements by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3182

Feat: Data Quality Tab by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/3183

[ISSUE-2113] Database Service API Integration tests by @Beetelbrox in https://github.com/open-metadata/OpenMetadata/pull/3185

UI : New Data profiler Layout. by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3184

Fix #3151 - Ingestion profiler should use ORM Profiler by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3192

Feat #2857 - Adding UI support for glossary by @darth-coder00 in https://github.com/open-metadata/OpenMetadata/pull/3092

Fix #3150 - Missing count & value length tests by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3193

Fix #3124: Activity Feed: Add support for deleting a post by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/3161

Datetime concat issue fixed - Auth Client - Ingestion by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/3195

Fixing Snowflake Query and arrayDataType issue by @ayush-shah in https://github.com/open-metadata/OpenMetadata/pull/3174

fix: Azure SSO Scopes by @akash-jain-10 in https://github.com/open-metadata/OpenMetadata/pull/3176

Fix: Tour not moving to different steps by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/3198

Fix #3163 Description not capturing Bold/Italic. by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3207

Fix: issue-3199 Data Quality - Missing values by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/3209

Fix #3208 Data Quality - Blank profiler page by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3211

Fix #3064 Not able to create teams. by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3215

Fix #3100 Unable to update connection config of services by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3213

Fix: issue-2789 Unable to expand Tier1,Tier2 and Tier 3 description on breadcrumb by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/3212

Fix #3217 - Test case props should be unique by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3220

Fix: issue-3216 Data Quality - Min and Max value config error by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/3218

Fix #3180: Thread shows truncated information by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/3204

Minor UI Changes by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3222

Issue-2538: Add Iceberg type for Glue Table + Location Entity by @TeddyCr in https://github.com/open-metadata/OpenMetadata/pull/3210

Feat: Added new user profile page ui. by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/3229

Fixes: glossary/webhook page search loader, assets and other minor fixes by @darth-coder00 in https://github.com/open-metadata/OpenMetadata/pull/3232

Fixes #3239 Add support for using glossary terms as tag labels by @sureshms in https://github.com/open-metadata/OpenMetadata/pull/3240

updated json schema and schema docs by @parthp2107 in https://github.com/open-metadata/OpenMetadata/pull/3219

Fix #3221 - columnValuesToBeUnique vs. columnValuesToBeNotNull JSONs by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3255

Fixed: issue- 3226 and 3230 config schema changes by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/3253

Issue-3234: Rename default in role_entity to defaultRole by @harshach in https://github.com/open-metadata/OpenMetadata/pull/3235

Fix #3248 & #3251 - Update metrics and column profile by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3262

Fix #3257 Unable to add Owner to Pipeline Service by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3264

UI : Data profiler and Feed changes by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3267

Issue-3237: Airflow pipeline resource is not returning status for a workflow by @harshach in https://github.com/open-metadata/OpenMetadata/pull/3238

UI : Addressing 0.9.0 Feedback Part 1 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3269

Fix #3236: Add support for secure docker compose with an env file by @vivekratnavel in https://github.com/open-metadata/OpenMetadata/pull/3241

UI : Addressing 0.9.0 Feedback Part 2 by @Sachin-chaurasiya in https://github.com/open-metadata/OpenMetadata/pull/3274

Fix: Data quality bug fixes by @ShaileshParmar11 in https://github.com/open-metadata/OpenMetadata/pull/3272

Docs update by @harshach in https://github.com/open-metadata/OpenMetadata/pull/3275

Docs by @harshach in https://github.com/open-metadata/OpenMetadata/pull/3276

Fixes/08 03 2022 by @darth-coder00 in https://github.com/open-metadata/OpenMetadata/pull/3273

Revert "Docs" by @pmbrull in https://github.com/open-metadata/OpenMetadata/pull/3278

New Contributors

@cometta made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/2916

@snyk-bot made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3130

@Beetelbrox made their first contribution in https://github.com/open-metadata/OpenMetadata/pull/3185

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.8.1-release...0.9.0-release
Source code(tar.gz)
Source code(zip)
openmetadata-0.9.0.tar.gz(79.12 MB)
0.8.4-release(Feb 23, 2022)

This is a bug fix release for #2940.
Source code(tar.gz)
Source code(zip)
openmetadata-0.8.4.tar.gz(80.15 MB)
0.8.3-release(Feb 21, 2022)

This is a bug fix release for the #2490.
Source code(tar.gz)
Source code(zip)
openmetadata-0.8.3.tar.gz(80.14 MB)
0.8.2-release(Feb 18, 2022)

This is a bug fix release for the https://github.com/open-metadata/OpenMetadata/issues/2843
Source code(tar.gz)
Source code(zip)
openmetadata-0.8.2.tar.gz(80.14 MB)
0.8.1-release(Feb 18, 2022)

This is a bug fix release for the #2843
Source code(tar.gz)
Source code(zip)
openmetadata-0.8.1.tar.gz(80.14 MB)
0.8.0-release(Jan 25, 2022)
Access Control Policy

New entities called ‘Role’ and ‘Policy’ have been added.

A User has a ‘Role’. A ‘Policy’ can be assigned to a Role.

A Policy has a set of ‘Rules’. Rules are used to provide access to functions like updateDescription, updateTags, updateOwner and so on.

Can provide access to metadata operations on any entity.

A standard set of Roles with their Policies have been added in the new release.

‘Admins’ and ‘Bots’ can perform any metadata operation on any entity.

Admins can define policies through the Policy UI, and assign roles to the Users.

Manual Lineage

Enhance the lineage captured from machine metadata with user knowledge.

Users can edit the lineage and connect the entities with a no-code editor.

Drag and drop UI has been designed to add lineage information manually for the table and column levels.

Entities like table, pipeline, and dashboard can be dragged and dropped to the lineage graph to create a node.

The required entity can be searched and clicked to insert into the graph.

Event Notification via Webhooks & Slack Integration

Subscribe event notifications via webhooks.

Send metadata change events as Slack notifications

Provide timely updates to keep the data team informed of changes

Entity Deletion

API support has been added for entity deletion, both for soft delete and hard delete.

A deleted dataset is marked as deactivated in the OpenMetadata backend instead of hard deleting it.

Ingestion support has been added to publish entity deletion.

Enabled version support for deleted entities.

Version panel has been added for all the entities- Table, Topic, Pipeline, and Dashboard.

Previously, we were getting the change descriptions for a limited set of fields for the Topic entity; several other fields have now been included.

New Connectors

Supports Delta Lake, an open source project that enables building a Lakehouse architecture on top of data lakes.

Worked on the refactor of SQL connectors to extract the lineage.

Connector API was refactored to capture the configs on the OpenMetadata side and to schedule the ingestion via UI.

Other Features

DataSource attribute has been added to the ML model entity.

Python API has been updated to add lineage for ML Model entities.

A new tab called ‘Bots’ has been added to group users with isBot set to true.

Support Application Default Credentials or a keyless, default service account in BigQuery data ingestion.

Includes a feature tour for new users.

Source code(tar.gz)
Source code(zip)
openmetadata-0.8.0.tar.gz(80.15 MB)
0.7.1-release(Jan 10, 2022)
Fixed migrate issue for ./bootstrap-storage.sh migrate-all

Fixed sql v2 file to drop if exists on dbt_table_entity

Source code(tar.gz)
Source code(zip)
openmetadata-0.7.1.tar.gz(78.38 MB)
0.7.0-release(Dec 15, 2021)
Theme: Activity Feeds, DBT integration, Storage Location and Metabase, Druid, MLFlow connectors

Activity Feeds

Enables users to view a summary of the metadata change events.

The most recent changes are listed at the top.

Entities (tables, dashboards, team names) are clickable.

Displays 'All Changes' and 'My Changes'.

A feed has been provided for data you are 'Following'.

UX Improvements

New and improved UX has been implemented for search and its resulting landing pages.

The Explore page has an updated UI. Introduced a 3-column layout to present the search results and several visual element improvements to promote readability and navigation of the search results.

Users can filter by database name on the Explore page.

Support has been added to view the recent search terms.

Major version changes for backward incompatible changes are prominently displayed.

DBT Integration

DBT integration enables users to see what models are being used to generate tables.

DBT models have been associated with Tables and are no longer treated as a separate Entity on the UI.

Each DBT model can produce a Table, and all the logic and metadata is now being captured as part of it.

DBT model is accessible from a tab in the table view.

Storage Location

UI supports StorageLocation.

Can extract the location information from Glue.

The ingestion framework gets the details from Glue to publish the location information (such as S3 bucket, HDFS) for the external tables.

The table results view now displays the table location in addition to the service.

Elasticsearch

SSL-enabled Elasticsearch (including self-signed certs) is supported.

Automatically runs an indexing workflow as new entities are added or updated through ingestion workflows.

Metadata indexing workflow is still available; in case indexes need to be cleanly created from the ground up.

New Connectors

Metabase, an open-source BI solution

Apache Druid has been added to integrate Druid metadata.

MLflow, an open-source platform for the machine learning lifecycle

Apache Atlas import connector, imports metadata from Atlas installations into OpenMetadata.

Amundsen import connector, imports metadata from Amundsen into OpenMetadata.

AWS Glue - improved to extract metadata for tables and pipelines. Now uses the AWS boto session to get the credentials from the different credential providers, and also allows the common approach to provide credentials. Glue ingestion now supports Location.

MSSQL now has SSL support.

##Lineage View Improvements

Improved discoverability

Implemented incremental loading to lineage.

Users can inspect the Table’s columns.

Users can expand entity nodes to view more upstream or downstream lineage.

Helps data consumers and producers to assess the impact of changes to the data sources.

Other Features

Admins can now access the user listing page, filter users by team, and manage admin privileges

Updated the Redoc version to support search in the API, as well as to add query parameter fields fixes.

'Entity Name' character size has been increased to 256.

Upgraded Log4j to 2.15

Source code(tar.gz)
Source code(zip)
openmetadata-0.7.0.tar.gz(78.39 MB)
0.6.0(Nov 16, 2021)
Theme: Metadata Versioning, Events API, One-Click Ingestion and more

Metadata Versioning

OpenMetadata maintains the version history for all entities in the Major.Minor number, starting with 0.1 as the initial version of an entity.

Entity views in OpenMetadata provide a timeline visualization of all the metadata changes from version to version.

Metadata versioning helps simplify the debugging process. Users can view the changes and instantly identify if a recent change led to the data issue.

Events API

When the state of metadata changes, an event is produced that indicates which entity changed, who changed it, and how it changed

These events can be used to integrate metadata into other tools, or to trigger actions.

One-Click Ingestion deployment

UI integration with Apache Airflow as a workflow engine to run ingestion, data profiling

New Entities: ML Models and Data Models

Two new data assets have been added - ML Models and Data Models.

ML Models are algorithms trained on data to find patterns or to make predictions. Data Modeling tools such as dbt are getting adopted by many organizations.

New Connectors

AWS Glue

DBT

Maria DB

User Interface

In 0.6 release, the UI integration displays all the metadata changes of an entity over time as Version History. By clicking on the Version button, users can view the change log of an entity from the very beginning. The earliest version relates to the metadata pulled from third party systems using ingestion bots. The changes made by users or data engineers are displayed along with a timestamp. The changes in the database by automation are captured by the ingestion bot. Thereby providing a single pane view of the metadata’s evolution over time.

The UI supports setting up metadata ingestion workflows.

Improvements have been made in drawing the entity node details for lineage.

Entity link is supported for each tab on the details page.

Guided steps have been added for setting up ElasticSearch.

The entity details, search results page (Explore), landing pages, and components have been redesigned for better project structure and code maintenance.

Source code(tar.gz)
Source code(zip)
openmetadata-0.6.0.tar.gz(78.57 MB)
0.5.0(Oct 19, 2021)
Theme: Lineage, Data Reliability, Pipelines, Complex Types

Lineage

Schema and API support for Lineage

UI integration to show the lineage for Pipelines and Tables

Ingestion support for Airflow to capture lineage

Data Reliability

UI Integration for Data profiler

Unique , Null proportion

See how the table data grows through interactive visualization

New Entities: Pipeline

Add Apache Airflow as a pipeline service

Ingest all of your pipeline's metadata into OpenMetadata

Explore and Search Pipelines

Add description, tags, ownership and tier your pipelines

Complex Data types

Schema and API support to capture complex data types

Ingestion support to capture complex data types from Redshift, BigQuery, Snowflake and Hive

UI Support for nested complex data types, users can add description, tags to nested fields

New Connectors

Trino connector

Redash connector

Amazon Glue - In progress

User Interface

UI now completely built on top of JsonSchema generated code

Expand complex data types and allow users to update descriptions and tags

Pipeline Service and Details page

Pipeline Explore & Search integration

Search results will show if the query matches description or column names, description

Full Changelog: https://github.com/open-metadata/OpenMetadata/compare/0.4.0-pre...0.5.0
Source code(tar.gz)
Source code(zip)
openmetadata-0.5.0.tar.gz(75.61 MB)