Thought Leaders in Big Data: Sanjay Vyas, CEO of Diyotta (Part 3)

Sanjay Vyas: One issue when we started working with Sprint has been about how to collect all this generated information to bring it into the Big Data systems. Now that we are bringing it into the systems, the question is if there is any way that we can look at certain parameters while the activity is happening within 10 minutes so that you can identify the fraud patterns within that data. That is the second issue.

As you are looking at it while the data is streaming to these ecosystems, you are also checking whether any of those data records have an impact. As millions of data records are flowing into your Big Data ecosystem, we were able to provide the technology that could identify the patterns that can be recognized. They reduced their fraud analytics cycle by more than 1 week to less than 10 minutes or so because the data is available there right in time.

You are also able to identify fraudulent records using the parameters that we were able to contribute to the system. That was another use case, which was intriguing for me. We started looking at oral sayings from a financial perspective as well as from a time-saving perspective. That is how they are able to be more proactive. That was huge for the customer.

Sramana Mitra: Who do you see in deals as competitors?

Sanjay Vyas: As we started working in this segment and as we pushed this product out, it had the uniqueness of the architecture and was a pioneer in modern data ecosystem. The other tools that we were competing with were from old-school technology. They had done a great job in the last few years before the customers started realizing that the monolithic architecture that these old school technologies provide is not going to scale or work with the Big Data ecosystem. Initially, I would say that we were competing with the likes of Informatica, Talend, and IBM DataStage.

As we started moving forward, many of the other new and current competitors started adopting a similar architecture leveraging the large ecosystems for computing the data. We started to see a different set of competitors like Fivetran. Even though that was happening, the architecture we have is still unique because we had a different scalability factor in there.

Our entire technology is also modular whereas these new entrants were very cloud-focused. It makes sense with the timing; but as you start to grow, your technology should be able to work on cloud systems. That is where we have placed ourselves. 

Sramana Mitra: From what you are describing, you are in the integration layer. Talend and the Informatica are all part of the integrated ecosystem of the data infrastructure. 

Sanjay Vyas: That is absolutely right. 

Sramana Mitra: What do you see as open problems in the world that you live in?

Sanjay Vyas: In today’s world, a few of the problems that I see within the data ecosystem are mainly around the movement of data. That is where I think it needs to be swift and AI-driven. There are a lot of thoughts going around data integration and bringing the data as-is. A problem that people still need to come up with a solution for is the fact that it is not a dumping ground; your data has some information.

How do you get the information from it depends on some factors that are specific to your business. You still need some level of AI where you can generate the automation of which data is relevant and which is not. Whatever data is relevant needs to be brought to the analytics. I feel that the manual-driven approach to getting that data information out of the data is what a lot of companies are going to focus on in the next five or seven years.

The second problem I see is the democratization of data science. That is the second problem at the top of my list. There are groups that could do big data scientists, but we have to look at the democratization of that. Companies like DataRobot are on to it but I think we need to see more tools, features, and solutions around data science democratization. 

Sramana Mitra: Thank you for your time.

This segment is part 3 in the series : Thought Leaders in Big Data: Sanjay Vyas, CEO of Diyotta
1 2 3