<p><a href="https://il.linkedin.com/in/ohad-shacham-a084741">Ohad Shacham</a>, Sr. Research Scientist<br/></p><p><b></b></p><p><a href="https://www.linkedin.com/in/yoni-gottesman-83b77431/">Yonatan Gottesman</a>, Sr. Research Engineer</p><p><b></b></p><p><a href="https://www.linkedin.com/in/ebortnik/">Edward Bortnikov</a>, Sr. Director, Research</p><p><b></b></p><p>Scalable Systems, Yahoo Research Haifa, Verizon Media</p><figure class="tmblr-full" data-orig-height="798" data-orig-width="1244"><img src="https://66.media.tumblr.com/94eb99ba8e693868c7598d18085d8aac/e6ec9ac37cd210a9-52/s540x810/a720e0bca4040f9f12480e33d80ccc3ad6a24f30.png" data-orig-height="798" data-orig-width="1244"/></figure><p><b></b></p><p>We have awesome news to share with you about Apache <a href="https://omid.incubator.apache.org/">Omid</a>, a scalable transaction processing platform for Apache <a href="https://hbase.apache.org/">HBase</a> developed and open sourced by Yahoo. Omid has just <a href="https://phoenix.apache.org/omid.html">graduated</a> from the Apache Incubator program and is now part of Apache <a href="https://phoenix.apache.org/">Phoenix</a>. Phoenix is a real-time SQL database for OLTP and real-time analytics over HBase. It is widely employed by the industry, powering products in Alibaba, Bloomberg, Salesforce, and many others. Omid means ‘hope’ in Farsi, and as we hoped, it has proven to be a successful project. </p><p>In 2011, a team of scientists at <a href="https://research.yahoo.com/">Yahoo Research</a> incepted Omid in anticipation of the need for low-latency OLTP applications within the Hadoop ecosystem. It has been powering real-time content indexing for Yahoo Search since 2015. In the same year, Omid entered the Apache Incubator program, taking the path towards wider adoption, community development, and code maturity. A year ago, Omid hit another major milestone when the Apache Phoenix project community selected it as the default provider of ACID transaction technology.</p><p><b></b></p><p>We worked hard to make <a href="https://yahoodevelopers.tumblr.com/post/180863698576/a-new-chapter-for-omid">Omid’s recent major release</a> match Phoenix’s requirements - flexibility,  high speed, and SQL extensions. Our work started when Phoenix was already using the <a href="https://tephra.apache.org/">Tephra</a> technology to power its transaction backend. In order to provide backward compatibility, we contributed a brand new transaction adaptation layer (TAL) to Phoenix, which enables a configurable choice for the transaction technology provider. Our team performed extensive benchmarks, demonstrating Omid’s <a href="https://www.usenix.org/system/files/conference/fast17/fast17-shacham.pdf">excellent scalability and reliability</a>, which led to its adoption as the default transaction processor for Phoenix. With Omid’s support, Phoenix now features consistent <a href="http://www.vldb.org/pvldb/vol11/p1795-shacham.pdf">secondary indexes and extended query semantics</a>. The Phoenix-Omid integration is now generally available (<a href="https://phoenix.apache.org/download.html">release 4.15</a>). Notwithstanding this integration, Omid can still be used as a standalone service by NoSQL HBase applications.</p><p>In parallel with Phoenix adoption, Omid’s code and documentation continuously improved to meet the Apache project standards. Recently, the Apache community suggested that Omid (as well as Tephra) becomes an integral part of Phoenix going forward. The <a href="https://www.mail-archive.com/general@incubator.apache.org/msg70565.html">community vote</a> ratified this decision. Omid’s adoption by the top-level Apache project is a huge success. We could not imagine a better graduation for Omid, since it will now enjoy a larger developer community and will be used in even more real-world applications. As we celebrate Omid’s Apache graduation, it’s even more exciting to see new products using it to run their data platforms at scale.<br/></p><p><b></b></p><p>Omid could not have been successful without its wonderful developer community at Yahoo and beyond. Thank you Maysam Yabandeh, Flavio Junqueira, Ben Reed, Ivan Kelly, Francisco Perez-Sorrosal, Matthieu Morel, Sameer Paranjpye, Igor Katkov, James Taylor, and Lars Hofhansl for your numerous contributions. Thank you also to the Apache community for your commitment to open source and for letting us bring our technology to benefit the community at large. We invite future contributors to explore Omid’s new home repository at <a href="https://gitbox.apache.org/repos/asf?p=phoenix-omid.git">https://gitbox.apache.org/repos/asf?p=phoenix-omid.git</a>.</p>