Amundsen: one year later (Lyft Engineering)

On October 30 2019 we officiallyopen sourced Amundsen our solution to solve metadata catalog and data discovery challenges. Ten months later Amundsenjoinedthe Linux foundation AI LFAI as itsincubation project.

In almost every modern data-driven company each interaction with the platform is powered by data. As data resources are constantly growing it becomes increasingly difficult to understand what data resources exist how to access them and what information is available in those sources without tribal knowledge. Poor understanding of data leads to bad data quality low productivity duplication of work and most importantly a lack of trust in the data. The complexity of managing a fragmented data landscape is not just a problem unique to Lyft but a common one that exists throughout the industry.

In a nutshell Amundsen is a data discovery and metadata platform for improving the productivity of data analysts data scientists and engineers when interacting with data. By indexing the data resources tables dashboards users etc. and powering a page-rank style search based on usage patterns e.g. highly-queried tables show up earlier than less-queried tables these customers are able to address their data needs faster.

...

Read Full Post

News Link: https://www.linux.com/featured/amundsen-one-year-later-lyft-engineering/.
RSS Link: https://www.linux.com/feed/.

Linux Chatter is a news aggregator service that curates some of the best Linux, Cloud, Technical Guides, Hardware and Security news. We display just enough content from the original post to spark your interest. If you like the topic, then click on the 'read full post' button to visit the author's website. Use Linux Chatter to find content from amazing authors!

Note: The content provided has been modified and is not displayed as intended by the author. Any trademarks, copyrights and rights remain with the source.

Disclaimer: Linux Chatter sources content from RSS feeds and personal content submissions. The views and opinions expressed in these articles are those of the authors and do not necessarily reflect those of Linux Chatter.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.