Jump to content

Social Systems: Difference between revisions

Social Systems (view source)

Revision as of 16:16, 13 November 2022

3,207 bytes added ,  16:16, 13 November 2022
no edit summary
No edit summary
No edit summary
Line 10: Line 10:
== What ==
== What ==


How to design/foster social structures / incentives / programs for fostering synthesis-friendly work, such as writing living literature reviews, adding metadata to experiments, etc.?
How to design/foster social structures / incentives / programs for fostering synthesis-friendly work, such as writing living literature reviews, adding metadata to experiments, etc.


== Resources ==
== Async: Potential Next Steps ==
 
 
[[Matt Clancy]]
 
* [https://docs.google.com/document/d/1FFdCnLEEeIzx91IMA7zg_K7rQztI4JtqTt7cKbu6YT0/edit?usp=sharing Atlas Academia : A proposal (CSCW version)]
* [https://newthingsunderthesun.com/, https://newthingsunderthesun.com/,]
 
[[Martin Karlsson]]
 
On "''organize thought and writing on a central theme/problem to facilitate future work''" track, if there is interest, I would be keen to bring together those that would like to map out:
 
# The structural options for rewarding contribution.
# Learnings from past and ongoing attempts (what truly motivates sustainable participation).
# New funding sources that could sustain those reward mechanisms.
 
Then map to the enabling effects of the tooling and model initiatives occurring  across the workshop. One goal would be to connect the thread from these new funding sources and methods to the attribution and reward mechanisms offered by discourse graph and synthesis tooling.


* [https://sourcecred.io/ SourceCred]
* Golden - [https://docs.golden.xyz/protocol/how-to-get-involved/reward-function-development Reward function development]
* [https://protocol.ai/blog/hypercert-new-primitive/ HyperCerts]
* [https://www.youtube.com/watch?v=1soPQ31ZHkQ Impact Evaluators]
* [https://scienceplusplus.org/metascience/ An Engine of Improvement for the Social Processes of Science], by Nielsen and Qiu


*
== Day 1: Goal for the workshop ==
'''Expected outcome'''


== Goal for the workshop: ==
<code>'''Resources''', such as a system map/synthesis of the problem space, synthesis/directory of tools, essential reading list, case study library, or shared synthesis benchmark dataset</code>
<blockquote>'''Resources''', such as a system map/synthesis of the problem space, synthesis/directory of tools, essential reading list, case study library, or shared synthesis benchmark datase</blockquote>
* T'''he best tools in the world mean nothing if no one adopts them'''. Let’s merge together small scale testing, with rigorous validation.
* T'''he best tools in the world mean nothing if no one adopts them'''. Let’s merge together small scale testing, with rigorous validation.
* Create a resource that the tool builders across the group can glance at to not lose sight of the critical point of adoption. With practical examples of how these mechanisms are designed, iterated upon, and how they can be tested and communicated to academia.   
* Create a resource that the tool builders across the group can glance at to not lose sight of the critical point of adoption. With practical examples of how these mechanisms are designed, iterated upon, and how they can be tested and communicated to academia.   
Line 42: Line 53:
# Incentive mechanisms for contributing and maintaining a collective knowledge graph
# Incentive mechanisms for contributing and maintaining a collective knowledge graph


== Day 2: Outcome - Patterns and ID cards for new incentives mechanism design and adoption  ==
<code>ToDo: add summary /context for converging on Patterns and Incentive Mechanism Cards</code>
❓[[Question]] What are the patterns for designing a new incentive mechanism system, from inception to adoption by academia?
❓[[Question]] How do we know if a new incentive mechanism or tool is ready for academia?
❓[[Question]] What drives the acceptance and onboarding of scientists?  


== Potential Next Steps ==
=== '''💡''' [[Claim]] Patterns ===
''Patterns come from our reflective observations about our hands-on interactions to solve problems in the world. One simple definition is that a pattern is a repeatably applicable solution to a problem that arises in a specific context. What’s the pattern form?''


See the example of the [http://scrumbook.org/ Scrum Patterns] book that used  "A pattern language: Towns, buildings, construction." book as reference


[[Matt Clancy]]
* Common building blocks of mechanism design:
** Problem
** Frequent approaches or solution
** How to test / quantify?
 
Any people that designs new mechanisms
 
<code>ToDo: summarise the idea better</code>
 
=== '''💡''' [[Claim]] '''ID Cards for new incentive mechanisms''' ===
''Serve to disclose information about a new mechanism design.  What would be the sections of a model card for a new incentive mechanism? Who proposed it, assumptions made, type of incentivized behavior,  riks and perverse behavior, evaluation, theoretical support…''
 
 
<code>ToDo: copy the 1st draft of Mechanism Cards from:</code> https://docs.google.com/document/d/1g1V4WKKmIaEajC9AW9fdbqOnTd7joaasc-AjFDYNC5o/edit#heading=h.pjvcgnypdp3a
 
=== '''💡''' [[Claim]] '''Wiki of incentive mechanisms''' ===
 
* Create an “incentive mechanism card”, a structure on the wiki
 
* imagine we have a wiki of all incentives ever designed, what would be the “mandatory” sections?
* Convert one of the examples in the chat to that structure
 
 
Both '''Patterns''' and '''Incentive Mechanism Cards''' can be converted to wiki structures. These resources are complementary in the sense that Patterns can be small cards that we consult when designing a new mechanism,  while ID cards  would be unique identifiers of new mechanisms (they can
 
=== Future Directions: ===
 
* Create a Wiki ''Structure for Incentive Mechanism Card''
* Create and fill wiki pages for some examples of Incentive Mechanisms
* Idea: invite designers to create ''Patterns for Mechanism Design''
 
 
== Examples of Incentive Mechanisms ==
<code>ToDo: copy from messages on Discord</code>
 
 
== Bibliography & Resources ==


* [https://docs.google.com/document/d/1FFdCnLEEeIzx91IMA7zg_K7rQztI4JtqTt7cKbu6YT0/edit?usp=sharing Atlas Academia : A proposal (CSCW version)]
*[https://sourcecred.io/ SourceCred]
* [https://newthingsunderthesun.com/, https://newthingsunderthesun.com/,]
* Golden - [https://docs.golden.xyz/protocol/how-to-get-involved/reward-function-development Reward function development]
* [https://protocol.ai/blog/hypercert-new-primitive/ HyperCerts]
* [https://www.youtube.com/watch?v=1soPQ31ZHkQ Impact Evaluators]
* [https://scienceplusplus.org/metascience/ An Engine of Improvement for the Social Processes of Science], by Nielsen and Qiu




Just on giant labs book: https://www.biorxiv.org/content/10.1101/2022.04.25.489391v1.full.pdf


[[Martin Karlsson]]
Other examples of pattern libraries: https://decentpatterns.xyz/library/


On "''organize thought and writing on a central theme/problem to facilitate future work''" track, if there is interest, I would be keen to bring together those that would like to map out:
rescognito.com for contributions


# The structural options for rewarding contribution.  
Something built on top of <nowiki>https://credit.niso.org/</nowiki>
# Learnings from past and ongoing attempts (what truly motivates sustainable participation).
# New funding sources that could sustain those reward mechanisms.  


Then map to the enabling effects of the tooling and model initiatives occurring  across the workshop. One goal would be to connect the thread from these new funding sources and methods to the attribution and reward mechanisms offered by discourse graph and synthesis tooling.
<nowiki>https://anagora.org</nowiki> is the prototype :)


== Relevant Messages  ==
* [https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7046208/ The views, perspectives, and experiences of academic researchers with data sharing and reuse: A meta-synthesis]
* [https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8808319/ Incentivising research data sharing: a scoping review]
Retrieved from "https://synthesis.jon-e.net/Special:MobileDiff/1398"