Funding Request: Peer-Reviewed Academic Research on UMA

Name of Project: Use cases for optimistic oracles in Web3: A Case Study of UMA

Proposer: `Justin Goldston, PhD

Proposal Summary: The goal of this peer-reviewed academic case study is to raise awareness of optimistic oracles and to bring more users and developers into the UMA ecosystem and the Web3 space.

Project Description: To introduce Web2 developers and natives into the Web3 space, the team is looking to conduct a peer-reviewed academic journal article on Optimistic Oracles using UMA in a case study approach. As students and researchers are becoming increasingly interested in blockchain and Web3, given the events that occurred in 2021 and 2022, developers are increasingly needed across all ecosystems. This study will not only provide insight into the tooling that powers Web3, but it will also introduce UMA to a pool of developers to further build out solutions for the ecosystem. In this study, we will look at the current uses for Optimistic Oracles, such as for synthetic assets, swaps, derivatives, and for bridges, such as Across. We will also look at future state solutions for Optimistic Oracles in industries such as law, supply chain, insurance, and healthcare organizations participating in Decentralized Science (DeSci).

We will begin this study by conducting a literature review of the current academic research on oracles, including interviews done by Hart Lambur and Clayton Roche. We will also review Medium articles written by Hart Lambur and the UMA team to provide practical insight into Optimistic Oracles. Once the literature review has been completed, we will provide a conceptual view of how UMA could onboard Web2 users and organizations into the ecosystem. Finally, based on our findings, we will include a section for further research to encourage other academics to assess use cases where Optimistic Oracles could be applied.

As we deliver blockchain and Web3 workshops at a number of institutions, students from various programs attend our events. During these events, we purposely pair Computer Science students with students from other programs, such as Business, Law, Supply Chain, Accounting, etc., so they can brainstorm about use cases where the protocols we are discussing can be applied. The same exercise can be done with UMA, where we could deliver an Ethereum workshop and include a section for Optimistic Oracles, and students from other programs could work with Computer Science students to propose solutions.

Value Add: As the team looks to disseminate the results of the study at a number of institutions, we will be exposing the UMA ecosystem to major sources of developers at these colleges and universities. From our experience in delivering blockchain and Web3 sessions in the past, students are willing to share their GitHub profiles in order for us to share them with potential employers - the protocols and projects such as UMA. This would be a great opportunity for this project as students are curious about the tooling that will power Web3.

Deliverables:
Milestone 1
Objective: Understand the current state of OO use within the UMA ecosystem and across partners such as Polymarket, Across, and the Boba Network through interviews with devs and users.
Deliverables: A literature review draft and the study instrument that will be used to survey the subject matter experts within the study.

Milestone 2
Objective: We look to answer the following research questions:
RQ1: Can new frameworks be implemented around the dispute process for UMA’s solution?

RQ2: Is the $UMA token distribution hurting the effectiveness of the oracle?
This will be done using a modified Delphi approach that will be composed of three rounds of surveys to understand if a consensus can be reached among the group of subject matter experts on the two research questions.

Deliverable: The results of the survey and the output of the results using SurveyMonkey. The goal is to have the output lead to proposals that can be implemented within the UMA ecosystem.

Milestone 3
Objective: Add the results of the survey to the academic journal article.
Deliverable: A peer-reviewed academic journal article outlining the study conducted with the UMA ecosystem and the results.

Total Budget Requested: The proposed about is 18,150 USDC or the equivalent in UMA tokens. Please see the budget outline at the lnk below UMA Budget V1.0.xlsx - Google Sheets
Address: 0x717cE4F9A743abecD4D5aE9b6a44b223fF952128

Team
The project team members are as follows:

Dr. Justin Goldston - Justin Goldston is a Professor at Penn State University, as well as a Visiting Professor and Graduate Advisory Board Member at Georgetown University and the University of Southern California. His research is focused on blockchain, social impact, and the metaverse, and is a five-time TEDx speaker on blockchain. Please see some of his journal articles in the next section.

Dr. Anoop V.S. - Dr. Anoop is a Professor and Senior Scientist in India, where his focus is on blockchain and artificial intelligence. As the author and co-author of many highly-cited academic journal articles focused on emerging technologies, his research experience is invaluable to the team and this project.

Tomer Jordi Chaffer - Jordi is a graduate researcher at McGill University in Canada and is also the co-author of The Metaverse as the Digital Leviathan: A Case Study of Bit.Country (in the next section). As an international speaker on blockchain, Jordi’s research is focused on blockchain within the healthcare sector.

George Martinez - George Martinez is a doctoral candidate at the University of the Cumberlands, where he is studying Blockchain and International Business. As the co-author of The Metaverse as the Digital Leviathan: A Case Study of Bit.Country, George brings over 20 years of practical experience in the Computer Science field to the inclusion of Ethereum within the industry.

Relevant past publications from the project team

This is the link to Goldston’s Anoop’s book published by Taylor and Francis entitled “Blockchain for Industry 4.0: Emergence, Challenges and Opportunities” Blockchain for Industry 4.0: Blockchain for Industry 4.0: Emergence … - Google Books

This is the first peer-reviewed academic case study on soulbound tokens written by Justin Goldston and Jordi Chaffer. - View of On the Existential Basis of Self-Sovereign Identity and Soulbound Tokens: An Examination of the “Self” in the Age of Web3

This is the first peer-reviewed academic case study on the metaverse written by Justin Goldston, Jordi Chaffer, and George Martinez. - BitCountryCase.pdf - Google Drive

This is the first peer-reviewed academic case study on hybrid finance (HyFi) written by Justin Goldston and Anoop V.S. - AcalaCase.pdf - Google Drive

This is the Google Scholar profile for Justin Goldston - Justin L Goldston, PhD - Google Scholar

This is the Google Scholar profile of Jordi Chaffer. - Tomer Jordi Chaffer - Google Scholar

This is the Google Scholar profile for Anoop V.S. - Dr. Anoop V. S. - Google Scholar

LinkedIn Profiles:

Justin Goldston: https://www.linkedin.com/in/justin-goldston/
Anoop V.S., PhD: https://www.linkedin.com/in/anoopacademia/
Tomer Jordi Chaffer: https://ca.linkedin.com/in/jordichaffer
George Martinez: https://www.linkedin.com/in/georgeamartinez/

Additional Information

Previous communications with the UMA team.

Questions from Clayton in Dec. 2022

Clayton

Admin

Dec '22

It’s like you knew exactly what I wanted for Christmas!

there are only two academic studies that mention optimistic oracles and hope that this research study fills that gap while also highlighting the UMA ecosystem.

Could you provide a quick summary? Are they relevant?

I’m curious what your thesis will be, other than with the goal of raising awareness. Is it the general thesis that OO’s are important? I think that’s valuable, for sure.

And perhaps this would go too deep, too fast, but I think that the actual product of UMA needs some R&D around its dispute process. We have had a number of disputes that arise due to ambiguity around natural language. Users of the Polymarket have walked away dissatisfied with the opacity and seeming arbitrariness of resolutions in cases where there is ambiguity.

Why is this happening? And what framework could you propose, after researching historical disputes, as well as related research in crowd wisdom and prediction markets, to help users predict exactly how a case with revealed ambiguity would resolve?

Another valuable insight would be to answer the question: Is the $UMA token distribution hurting the effectiveness of the oracle? If so, what do you propose?

I think a great next step might be for us to do a community AMA on this, where you could talk about what you’re interested in working on here and what the community thinks. My DMs are open on Twitter if you’re willing to arrange such an event!

Response to Clayton

Clayton,

Thank you for your response. Please see my responses below:

There are only two academic studies that mention optimistic oracles and hope that this research study fills that gap while also highlighting the UMA ecosystem.

Could you provide a quick summary? Are they relevant?

Below are the two studies.

Caldarelli, G., & Ellul, J. (2021). The blockchain oracle problem in decentralized finance—A multivocal approach. Applied Sciences, 11(16), 7572.

Rahman, A., Shi, V., Ding, M., & Choi, E. (2022). Systematization of Knowledge: Synthetic Assets, Derivatives, and On-Chain Portfolio Management. arXiv preprint arXiv:2209.09958.

Rahman et al. compare UMA’s oracles with Chainlink’s oracles in their study on synthetic assets in DeFi.

Caldarelli and Ellul mention UMA’s OO and the Data Verification Mechanism (DVM), and compares UMA to Tellor and Razor. This study will prompt us to dig into those projects to understand their dispute process.

I’m curious what your thesis will be, other than with the goal of raising awareness. Is it the general thesis that OO’s are important? I think that’s valuable, for sure.

It initially was a general thesis, but based on the issues you raised below, the general thesis will become the literature review, and we will form research questions as follows:

*Proposed before the AMA

RQ1: Can new frameworks be implemented around the dispute process for UMA’s solution?

RQ2: Is the $UMA token distribution hurting the effectiveness of the oracle?

And perhaps this would go too deep, too fast, but I think that the actual product of UMA needs some R&D around its dispute process. We have had a number of disputes that arise due to ambiguity around natural language. Users of the Polymarket have walked away dissatisfied with the opacity and seeming arbitrariness of resolutions in cases where there is ambiguity. Why is this happening? And what framework could you propose, after researching historical disputes, as well as related research in crowd wisdom and prediction markets, to help users predict exactly how a case with revealed ambiguity would resolve?

The methodology will be a modified Delphi approach which is where we survey a panel of experts with questions centered around the two research questions above in hopes that we reach a consensus on the next steps. I foresee the panel of experts being Requestors, Proposers, and Disputers within the UMA and the participants we can find in the Polymarket ecosystem. I performed a modified Delphi approach for my doctoral dissertation, and it works well as the survey participants want to know the answers to the questions as well.

With this approach, not only will we raise the awareness of UMA and OOs, but the output of this study will hopefully be a proposal for the community to vote to implement the proposed solutions.

These are my initial thoughts, but I would first like to conduct interviews with the community to better understand why they think this happens. From there, we will review other projects, such as Tellor, Razor, and Chainlink, to see if there are processes that could be included in our survey.

In initial research on disputes, many have noted that disputes don’t happen often. Do you know how many disputes occurred in 2022?

Another valuable insight would be to answer the question: Is the $UMA token distribution hurting the effectiveness of the oracle? If so, what do you propose?

We formed this as a research question and would gain insight from the community to get input in forming the survey questions.

I hope my responses answer your questions, and I sent you over my information via Twitter.

Question from Alex in December

This is a very interesting application! For the 3 milestones referenced in the spreadsheet, would it be possible to provide details regarding objectives and deliverables associated with each milestone?

Response to Alex

Alex,

Thank you for your response. Please see the objectives and deliverables for each milestone below. I also updated the spreadsheet.

Milestone 1
Objective: Understand the current state of OO use within the UMA ecosystem and across partners such as Polymarket, Across, and the Boba Network through interviews with devs and users.

Deliverables: A literature review draft and the study instrument that will be used to survey the subject matter experts within the study.

Milestone 2
Objective: We look to answer the following research questions:

RQ1: Can new frameworks be implemented around the dispute process for UMA’s solution?

RQ2: Is the $UMA token distribution hurting the effectiveness of the oracle?

This will be done using a modified Delphi approach that will be composed of three rounds of surveys to understand if a consensus can be reached among the group of subject matter experts on the two research questions.

Deliverable: The results of the survey and the output of the results using SurveyMonkey. The goal is to have the output lead to proposals that can be implemented within the UMA ecosystem.

Milestone 3
Objective: Add the results of the survey to the academic journal article.

Deliverable: A peer-reviewed academic journal article outlining the study conducted with the UMA ecosystem and the results.

  • Yea
  • Nay

0 voters

In my opinion giving 18k to a grant request that only does surveys and a report is too much.

I have seen other proposals with more value than this receiving a lot of criticism and pullbacks. I’m impressed that nobody has replied here. @Mhairi

Essentially we are paying 4 people to learn about UMA. I think this is ridiculous. Should we pay to all community members joining then? Or is is just because the PhD part at the end of the title.

I have worked in academia and I know how things move out there. Normally researchers get funding from Institutional sources.

The second milestone is about doing a survey. So, UMA is paying 15k just for a survey. I think this is one of the most expensive surveys I have ever seen.

@HetmanJones, Thank you for sharing your thoughts and concerns, and I would like to address some of them. Regarding a simple survey and study, we are proposing a multi-phased approach where we will understand the current-state issues within the UMA ecosystem regarding OOs through interviews. In doing this, we leverage a “voice of the customer” approach that will result in proposed solutions that will provide short term benefit to the ecosystem.

Additionally, with uncertainty looming in the United States on the topic of staking, we are taking a long-term view of UMA from a use case perspective for the sustainability of the ecosystem. If we soon see regulation with staking and with stablecoins, this is may also have a trickle down effect for other blockchain-based solutions such as Polymarket. If we find other industry use cases for OOs, UMA will be ahead of the Chainlinks , the Tellors and the Razors. By gaining insight from Web2 users and organizations, more strategic solutions can be proposed in this study. If you haven’t done so, please listen to the AMA from this week where I mention a few of those use cases - https://twitter.com/umaprotocol/status/1623781193211838464?s=46&t=PeBi8sB4joJQFJgx4Ywqbg.

For one of those use cases, members of the team that look to conduct this study just concluded a study for the Web3 Foundation. With that study, Jurgen Schouppe and the team at SafeHaven are looking to integrate the proposed solutions with their patented technology - EP3654578A1 - Methods and systems for cryptographic private key management for secure multiparty storage and transfer of information - Google Patents - and build on Kusama and eventually Polkadot.

Additionally, to address your statement that 18k is on the high end for an academic research study, the Web3 Foundation issued a grant larger than 18k that will result in a roadmap for an open-source solution that will be available for everyone within the Polkadot and Kusama ecosystems.

Finally, as I see you are leading the Cora Protocol team, we also see a number of use cases for your protocol. As a few individuals from the ecosystem on the Twitter Space yesterday highlighted things they would like to see reviewed and researched in the study, do you have any ideas on your end?

Thanks for the proposal @justin.goldston

I support it as I think this type of effort and documentation fits the historical brand voice of what we want UMA to be and will hopefully have valuable data to refine approach on uses cases for the OO and UMA. I also think the requested amount is reasonable for the scope of the work.

My one ask or suggestion is that some critical thought and decent effort goes into getting some visability on both deliverables from milestone 1 & 3 to the internal UMA DAO/COmmunity/Team as well as more broadly across the WEB3 and academic ecosystems as that is where I see a huge percentage of the value of this. Would love to hear some ideas on how you plan to do that.

Thanks and best of luck!

@EAsports, thank you for your support on this proposal. To answer your questions, once milestone 1 is complete, we will post the literature review here on Discourse, on Discord, as well as on Github for review and feedback. For interviews that take place, they will be published on the SydTek DAO YouTube channel, along with the Women in Blockchain Canada YouTube channel. Justyna Osowska of Women in Blockchain Canada has interviewed Ben Armstrong (BitBoy Crypto), Ben Goertzel of SingularityNET, and Michael Kong - CEO of the Fantom Foundation. BitBoy responded to one of Justyna’s posts on Twitter this weekend, and we are attempting to coordinate another interview with Ben at EthDenver. With that, we will promote the interviews across social media platforms to amplify the work and research that is being done in the UMA ecosystem.

For milestone 3, the final study will also be published here on Discourse and on Discord for community review. Once we receive community approval, we will submit a preprint to ArXiv, as that is the first point of review from the blockchain, Web3, and cryptography communities from an academic research perspective. This is the process we just completed for a study we did for the Web3 Foundation. Please see that study here - [2301.11074] Digital Inheritance in Web3: A Case Study of Soulbound Tokens and the Social Recovery Pallet within the Polkadot and Kusama Ecosystems. We will then reformat the article to submit to IEEE Access, one of the top open-access journals in academia. I stopped submitting to other journals as they keep the research behind paywalls, and I feel we are all here to disseminate this research, knowledge, and information to all.

Finally, I have been invited to speak at the Coin Bureau Conference in London in June, and I have specifically been asked to discuss research I’m doing in the academic space. If this proposal is approved, this study will be one that I will discuss as it is a win-win-win for all.

The result of the temp check was

  • 9 voters
  • 100% in favour
  • 0% against.

The proposal will now go forward to a snapshot vote starting 23rd Feb

[Link to snapshot added here once open]

If the proposal achieves 51% of votes with a quorum of 10% of the circulating supply it will go forward to the UMA voter dapp for UMA tokenholders to vote on-chain.

A snapshot vote on this funding request will go live in approximately 1h and will remain open for 5 days.
https://snapshot.org/#/uma.eth/proposal/0x9fdf10202698ae8172ee9542f3c26f2837a1cd4ad7cc399b502b36c8b4f1edff

The final results on the snapshot vote for this proposal were

  • For - 467k UMA (99.47%)
  • Against - 2.5k UMA (0.53%)
  • Quorum - 269k / 3.3M

As this proposal has not reached quorum, it will not forward for an onchain vote