We’re excited to announce that KNN3 launched a prototype data service called DJMP(Data Job Management Panel) that allows hybrid smart contract developers to construct data pre-processing jobs on off-chain environments (data warehouse & execution container), and connect these data jobs to smart contracts function executables, DJMP also provide job scheduling and auto pre-processing which empowered by Chainlink Automation.

🚀To experience DJMP: http://jobkeep.staging.knn3.xyz/

Challenges & solutions on data processing

Currently, it is difficult for developers to process on-chain and off-chain data directly through smart contracts. 

1. First, smart contracts have limited data processing capabilities. 

2. Second, delivery data to smart contracts via oracle requires enhancements on data service flexibility. 

3. Third, the processing jobs need to be managed without heavy coding and with accessible user interfaces in a decentralized approach.

How does DJMP propose solution work in a user-friendly interface

With the KNN3 DJMP, developers are allowed to execute a job that can process off-chain data and deliver results to smart contracts with scheduling through smart contracts. The configuration can be done easily in a user-friendly interface.

KNN3 DJMP is an integrated panel, one stop for on-chain and off-chain data fetching, processing, and delivery with Chainlink tool set.

Value Proposition & Benefits of KNN3 DJMP:

• Integrated: 

  • API service deployed on Chainlink Node

  • Job scheduling and triggered via Chainlink Automation

  • Result delivered to smart contract directly with ChainlinkClient

• Computation capability: 

  • Range from raw data fetching, data aggregation, to pre processed models

• Light-coded: 

  • User-friendly interface, customized script constructed as individual job at the back-end for easy deployment

Major functioning components

Data Preparation

• With a job instance created, users can select the data sources that they are interested in which are available in KNN3 data warehouse.

Data Processing

• Users can decide how they want the data to be processed, including raw data, customized aggregation through SQL, ready to use algorithms, and customized algorithms.

Data Delivery

• Through the interface, users can configure the frequency of data delivery and where they want the data to be stored. They are provided with the options of decentralized file storage (IPFS, Arweave), cloud storage (S3, TiDB), and smart contracts.

Smart Contract scheduling with Chainlink Automation

With Chainlink Automation, we can automate the data sync process in a trustless periodical manner. Given the cost and efficiency, the charge-per-use model also can be provided with a configurable query designed to process targeted addresses per request.

If users want the job to be executed with customized schedules, they can configure the parameters easily from the panel interface by some dropdown lists. The job panel will register their job schedules in Chainlink automation with a simple button click.

Smart Contract Data delivery & storage with Chainlink Any API

With a job service registered in Chainlink Node, it will listen to the data delivery smart contract based on ChainlinkClient. When the data delivery smart contract is triggered by Chainlink Automation, the job in Chainlink Node will be executed and send the result to data delivery smart contract through Chainlink Oracle.

Vision in BuidL

KNN3’s vision is to be an all-in-one DataFi (verifiable Data-as-a-Service) solution platform, derived from traditional Data-as-a-Service, which will be a fundamental service type in web3. To keep the intrinsic value of web3 data, data interoperability should be encapsulated in trustless data flow.

Hence, KNN3 will be dedicated to work on KNN3 DJMP and make it a more integrated and scalable product through following facets:

• All-in-one

  • minimize cross platform work

  • smart contract deployment within the panel

• Computation capability

  • allow customized aggregation through SQL

  • customized ML model deployment

  • on-demand triggering for Transactional Processing jobs

  • periodical job registration & keeping for Analytical Processing jobs

• Role-controlled account management

  • access key generated based on role with specific capability

  • dashboard to track key usage and resource usage

• Scalable

  • optimal performance with resource management strategy

  • instances allocated to each account with demanded resource

  • open for quota increase per request

Special Thanks to Chainlink

Great thanks for all the support from Chainlink, the industry standard for building, accessing, and selling oracle services needed to power hybrid smart contracts on any blockchain. Without their solid support and integration, we cannot visualize & simplify our contract deploy process.

Learn more about Chainlink by visiting chain.link or reading the developer documentation at docs.chain.link. 

About KNN3 Network

KNN3 Network is a one-stop Web3 User-centric DataFi solution for d/Apps and smart contracts. KNN3 allows d/Apps & smart contracts to interact with cross-platform user-centric data in multiple algo-friendly ways.

Website |Twitter |Discord |Mirror |Medium