I planned on trying out Decodable to maybe some later day migrate a previously batched pipeline. It worked fine and was cheap, but I never had real-time data for testing.
After about 3 hours of tinkering on a slow Tuesday afternoon, not only did I finish my tests, but actually migrated the whole pipeline. And reduced technical debt in the meantime, as there now are fewer systems to maintain.
I checked in with my stream a few times, but never had to adjust anything (so far). It just works. Review collected by and hosted on G2.com.
My stream only processes about 1 to 2 records per second - even the small tasks are overpowered for that. To save energy and resources, even smaller task sizes (maybe by sharing task resources?) would be cool :) Review collected by and hosted on G2.com.
Decodable is a tool that unlocks a lot of use cases for us that were previously not achievalable for our team. With our AI pipelines, we require customer updates to take effect immediately. For example, if they change a document (PDF, DOCX), we need it to be updated and reindexed in our vector databases so that the new information can be surfaced in AI pipelines. It would be impossible to perform these updates in a timely manner if we rely on batch jobs.
Decodable is very effective at simplifying the monitoring of these updates (through Change Data Capture), and running the updates through a custom pipeline for us. For use cases that literally only need to move data from point A to point B, Decodable is a lot simpler and doesn't need much code maintenance.
Real time streaming will always take effort and require different thinking. The Deodable team has done a very good job in abstracting a huge amount of the complexity, allowing us to focus on our business logic. The support has been great all the way, which is important for a team like ours that wasn't used to Flink.
When it comes to simplifying infrastructure for streaming needs, this is where Decodable really shines. We are not bothered by keeping uptime of Kafka and Flink infrastructure, which can be a lot of work. Review collected by and hosted on G2.com.
The Decodable team moves fast but as one of the earlier adopters, we certainly had to adjust to some of the limitations. For example, we used Java Flink even if our team was more comfortable in Python. A month after that decision, PyFlink Beta was rolled out. We also had to do some extra work around CI/CD. At the pace of the Decodable though, I am confident that they will have a significantly refined product in the next few months. The support team has been super responsive for us. If only our timeline were one to two months later, we would have had a much easier time.
Similar to above, the process around updating pipelines isn't quite refined yet. It requires a bit of extra work on our end to write some scripts to help.
Batch vs streaming can also require a mindset change that takes getting used to. For example, joins are significantly more complicated. This is not the fault of the Decodable team though, it's just a fact of life that streaming will be a bit more complicated. Review collected by and hosted on G2.com.
Decodable makes creating streaming data pipelines easy. They provide all the Debezium, Kafka, and Flink infrastructure with none of the complexity. Their API and CLI make it simple to manage your infrastructure in a consistent way. The team at Decodable is very responsive and always willing to dive in and help out when needed. I was able to get up and running very quickly as compared to standing up my own Debezium/Kafka infrastructure. Review collected by and hosted on G2.com.
Some of the advanced functionality exposed by the Debezium is not available in Decodable. Setting up destination streams and database tables could be more automated or streamlined. Review collected by and hosted on G2.com.
Our team was able to abstract away an intensive 5000+ schema union using decodable. We are now deploying custom Flink pipelines - the ETL capabilities are very broad and can be as complex or as simple as we need. Review collected by and hosted on G2.com.
Some small UI/documentation improvements would make getting up and running easier. Review collected by and hosted on G2.com.
Very easy to use real time SaaS platform, that makes prototype assembly quick and easy and shows flow of data using simple dashboards. Review collected by and hosted on G2.com.
FAQ is not very well laid out, making us reach out to support, but they are very quick to answer nevertheless. Review collected by and hosted on G2.com.
- Ease of use and very intuitive UI
- Great team, they helped us throughout our journey from POC to actual implmentation on Production
- Special mentions to Andrew, Gunnar and Nico for helping with our usecase of migrating Full-Text search from MySQL to ElasticSearch
- Customer support is very quick and regular weekly connects. Review collected by and hosted on G2.com.
- Nothing as such, Andrew and team always made sure that we never face any issues. Review collected by and hosted on G2.com.
Delivery of processed data without any duplicacy and without any loss of data. Review collected by and hosted on G2.com.
Documentation need bit more clarification as i have to struggled in searching few things. Review collected by and hosted on G2.com.
The Best Thing that I like about the decodable is the preview data and its ability to auto-scale without any manual intervention. Another feature that I like is real-time source, sink throughput, memory, and disk usage dashboards. Review collected by and hosted on G2.com.
There are so many configurations that we need to do while creating streams in decodable, for example, a user might be unknown to the watermark column, but it should be pre-populated and schema and format from Kafka as soon as the user selects a topic can also be prepopulated. Also, sometimes SQL errors are directly from flink SQL parser, we can wrap them and the user might get a good idea of where the error is. There is also no way to connect multiple sql queries one by one, this might be a good feature Review collected by and hosted on G2.com.
There are two things I like best: 1) Decodable makes it super easy to do prototyping, sandboxing, etc. 2) Decodable abstracts away the difficult parts of operating Flink. Decodable, as a company, is doing so many things well: it has a great architecture based on solid theory and proven open-source technologies. It's fully cloud-native, and they have built a team of industry experts with deep experience in the underlying technologies. Review collected by and hosted on G2.com.
The only downside is that it's still maturing in a relatively new space. There's still much ground to be taken, but the team is bringing new functionality at a very impressive rate. Review collected by and hosted on G2.com.