Jump to content

Interfaces: Difference between revisions

10 bytes removed ,  18:26, 12 November 2022
Update formatting
(Port the note from Google Doc)
(Update formatting)
Line 23: Line 23:
== Workshop goals ==
== Workshop goals ==


* Organization
* '''Organization'''
** Jodi: what can we map (discourse) of this workshop?
** Jodi: what can we map (discourse) of this workshop?
** Jay: we could find a common problem to work on, engaging in cycles of collaboration and competition
** Jay: we could find a common problem to work on, engaging in cycles of collaboration and competition
*** Similar to how early cognitive science pioneers proposed studying the mind/brain
*** Similar to how early cognitive science pioneers proposed studying the mind/brain
**** Focus on one thing as a discipline and reach a “thorough” description of it
**** Focus on one thing as a discipline and reach a “thorough” description of it
* Questions for workshop  
* '''Questions for workshop'''
** What is needed to build …[missed this part]  
** What is needed to build …[missed this part]  
** What is missing from current set of tools
** What is missing from current set of tools
** Incentivizing more people to get involved in collaborations - social systems  
** Incentivizing more people to get involved in collaborations - social systems  


* Projected outcomes  
* '''Projected outcomes'''
** Diagram processes/ types  
** Diagram processes/ types  
** Needs and solutions for collaboration, first principles
** Needs and solutions for collaboration, first principles
Line 39: Line 39:
== What could a tool do for synthesis (wiki style topic page) ==
== What could a tool do for synthesis (wiki style topic page) ==


* Processes within tool  
* '''Processes within tool'''
** - move towards stabilization, but could be never ending - always more things could be added
** - move towards stabilization, but could be never ending - always more things could be added


* Process (joseph)
* Process (joseph)
** Individual level:  
** '''Individual level:'''
** Discovery - finding right set of papers for literature review
** Discovery - finding right set of papers for literature review
** Sharing papers, notes on how papers were relevant  
** Sharing papers, notes on how papers were relevant  
** Collaborative:  
** '''Collaborative:'''
** Shared document - shuffle around -organizing -  Documents relevant!  
** Shared document - shuffle around -organizing -  Documents relevant!  
*** Wiki
*** Wiki
Line 57: Line 57:
** Identify gaps - subtopics  
** Identify gaps - subtopics  
** Pick out things central to paper  
** Pick out things central to paper  
** Iteration,  slack communication - converge  
** '''Iteration''',  slack communication - converge  


* Process (Jodi)
* Process (Jodi)
** Individual level
** '''Individual level'''
** Asynchronous: Send people an email about papers to look at.
** Asynchronous: Send people an email about papers to look at.
*** Linear process - share title first, doi, then abstract. Maybe add ideas about it.
*** Linear process - share title first, doi, then abstract. Maybe add ideas about it.
Line 66: Line 66:
** Early on - overview of the information landscape  
** Early on - overview of the information landscape  
*** “Keyword searching” inside Zotero -> Use of terms related to concept  
*** “Keyword searching” inside Zotero -> Use of terms related to concept  
** Collaborative: Lab Zotero collection
** '''Collaborative:''' Lab Zotero collection
*** Literature at the field level  
*** Literature at the field level  
*** Folders of different subtopics to make sure good coverage
*** Folders of different subtopics to make sure good coverage
*** [triaging] Manual auditing process when you are looking at 30+ things
*** [triaging] Manual auditing process when you are looking at 30+ things
** Individual level: Later - citation chasing (can sometimes become a rabbit hole)
** '''Individual level:''' Later - citation chasing (can sometimes become a rabbit hole)
*** Citation context are very useful for this because they point to interesting aspects of a paper
*** Citation context are very useful for this because they point to interesting aspects of a paper
** Writing - one level of synthesis, identifying gaps
** Writing - one level of synthesis, identifying gaps
Line 76: Line 76:
** Formal scoping review (similar to medical systematic reviews / meta-analysis)
** Formal scoping review (similar to medical systematic reviews / meta-analysis)
*** Current tool “EPPI-Reviewer”
*** Current tool “EPPI-Reviewer”
*** Comparable concepts, non-comparable but related, develop an evolving taxonomy (collaborative)
*** Comparable concepts, non-comparable but related, develop an '''evolving taxonomy (collaborative)'''
*** One person developing taxonomy, another commenting - linear - putting papers with concept types into categories  
*** One person developing taxonomy, another commenting - linear - putting papers with concept types into categories  
*** Ontology collaboration - shared vocabulary  
*** Ontology collaboration - shared vocabulary  
*** Becomes a shared mental model about topic at hand  
*** Becomes a shared mental model about topic at hand  
** Highly iterative, not same across projects  
** '''Highly iterative, not same across projects'''
** Sometimes use multi-modal formats (e.g. diagrams) for synthesis
** Sometimes use multi-modal formats (e.g. diagrams) for synthesis
** Concerns: diffuse topics, discussed differently across subdomains  
** Concerns: diffuse topics, discussed differently across subdomains  
Line 88: Line 88:
== Discussion about tools for synthesis ==
== Discussion about tools for synthesis ==


* Maybe PDFs are not evil?
* '''Maybe PDFs are not evil?'''
** MVP: moving beyond PDFs is hard, so using them as a starting point to gather insights may help (Jay).
** MVP: moving beyond PDFs is hard, so using them as a starting point to gather insights may help (Jay).
** E.g. claim extraction that users may do from scientific papers, may vary in different paper types (e..g theory)
** E.g. claim extraction that users may do from scientific papers, may vary in different paper types (e..g theory)
** Augmenting PDFs?
** Augmenting PDFs?
* People consume linearly  
* '''People consume linearly'''
** PDFs/pages/documents provide narratives that are easier to digest than graph
** PDFs/pages/documents provide narratives that are easier to digest than graph
** Sometimes with evidence maps/databases, it’s nonlinear (practitioner/policy maker searching for interventions)
** Sometimes with evidence maps/databases, it’s nonlinear (practitioner/policy maker searching for interventions)
Line 99: Line 99:
*** Tradeoffs: clear & succinct claims + readability
*** Tradeoffs: clear & succinct claims + readability
** Is the “best” way to write the “best” way to read?
** Is the “best” way to write the “best” way to read?
* The limitation of Wikipedia / large scale collaboration
* '''The limitation of Wikipedia / large scale collaboration'''
** How do you deal with conflicts and disagreements?
** How do you deal with conflicts and disagreements?
*** The Wisdom of Polarized Crowds (Wikipedia)
*** [https://arxiv.org/pdf/1712.06414.pdf The Wisdom of Polarized Crowds] (Wikipedia)
*** Argumentation frameworks (Computational Logic, Rhetoric)
*** Argumentation frameworks (Computational Logic, Rhetoric)
*** Conflict resolution literature
*** Conflict resolution literature
** How do you deal with higher coordination costs?
** How do you deal with higher coordination costs?
* How much support can we provide to scholarly and non-scholarly readers beyond PDFs?
* '''How much support can we provide to scholarly and non-scholarly readers beyond PDFs?'''
** Distill.pub offers some example explorable essays for inspiration
** Distill.pub offers some example explorable essays for inspiration
*** Excellent guide: <nowiki>https://distill.pub/2020/communicating-with-interactive-articles/</nowiki>
*** Excellent guide: https://distill.pub/2020/communicating-with-interactive-articles/
** Jay did some prototyping of explorable essays for scholars with embedded interactive simulations and received (anecdotal) feedback (old software startup).
** Jay did some prototyping of explorable essays for scholars with embedded interactive simulations and received (anecdotal) feedback (old software startup).
** Thomas is working on this issue (Jay would love to collaborate and chat long-term) with his educational psychology/tech background.
** Thomas is working on this issue (Jay would love to collaborate and chat long-term) with his educational psychology/tech background.
*** What are the low-hanging fruits?
*** What are the low-hanging fruits?
*** How can we speed up the process (because it’s time-consuming!)
*** How can we speed up the process (because it’s time-consuming!)
**** Motivation to contribute? → Consider awarding credits/tokens with Rescognito (<nowiki>https://rescognito.com/</nowiki>) to brag about.
**** Motivation to contribute? → Consider awarding credits/tokens with Rescognito (https://rescognito.com/) to brag about.
***** Consider beginning in classrooms and interdisciplinary journal clubs (in-person and virtual)
***** Consider beginning in classrooms and interdisciplinary journal clubs (in-person and virtual)
**** UI/UX process
**** UI/UX process
Line 124: Line 124:
***** Human-generated summaries
***** Human-generated summaries
****** Could be gone in a wiki tool like Roam Research or Obsidian or even Notion.
****** Could be gone in a wiki tool like Roam Research or Obsidian or even Notion.
****** Metadata for information  
****** Metadata for information


* Collaborative synthesis: what interfaces do we need? What solutions exist today? (written from the researcher’s perspective, focusing on digital tools)
* '''Collaborative synthesis: what interfaces do we need? What solutions exist today?''' (written from the researcher’s perspective, focusing on digital tools)
** What interfaces do we need for collaborative synthesis?  
** '''What interfaces do we need for collaborative synthesis?'''
*** We need ways to work with materials.
*** We need ways to work with materials.
**** This includes:
**** This includes:
***** Gathering things (collecting)
***** Gathering things (collecting)
***** Breaking them down (analyzing)
***** Breaking them down ('''analyzing''')
***** Organizing them (classifying, tagging, linking)
***** Organizing them (classifying, tagging, linking)
***** Combining them to create new things (synthesizing)
***** Combining them to create new things ('''synthesizing''')
***** … ?
***** … ?
**** This can be done with:
**** This can be done with:
***** Specialized software (e.g. reference management software for references)
***** Specialized software (e.g. reference management software for references)
***** Relational databases, graph databases
***** Relational databases, '''graph databases'''
***** Outlining, mind mapping
***** Outlining, mind mapping
***** Hypertext (e.g. wikis, plain text files with wikilinks…)  
***** '''Hypertext''' (e.g. wikis, plain text files with wikilinks…)  
***** … ?
***** … ?
*** We need collaborative writing interfaces that meet our scientific writing needs, which are:
*** We need collaborative writing interfaces that meet our scientific writing needs, which are:
Line 155: Line 155:
**** Backlinks
**** Backlinks
**** … ?
**** … ?
** What are our options if we want to do this right now?
** '''What are our options if we want to do this right now?'''
*** Multiple interoperable tools. This can be:
*** Multiple interoperable tools. This can be:
**** Web applications exchanging data via API?
**** Web applications exchanging data via API?
Line 175: Line 175:
=== Useful links ===
=== Useful links ===


* <nowiki>https://zettlr.com</nowiki>
* https://zettlr.com
** (a little about it)
** (a little about it)
* <nowiki>http://www.kialo.com</nowiki>
* http://www.kialo.com
** (a little about it)
** (a little about it)
* Polymath (link????)
* Polymath (link????)
** Collaborative problem-solving in mathematics.  
** Collaborative problem-solving in mathematics.  
* Rescognito (<nowiki>https://rescognito.com/</nowiki>)
* Rescognito (https://rescognito.com/)
** (a little about it)
** (a little about it)
* <nowiki>https://distill.pub/2020/communicating-with-interactive-articles/</nowiki>
* https://distill.pub/2020/communicating-with-interactive-articles/
** Excellent guide to Distill.pub
** Excellent guide to Distill.pub


=== Collaborative writing systems ===
=== Collaborative writing systems ===


* Manubot: <nowiki>https://manubot.org</nowiki> (see also related papers below)
* Manubot: https://manubot.org (see also related papers below)


=== Problems/solutions ===
=== Problems/solutions ===


* Citing often requires page numbers, especially in fields with long documents. HTML does not natively have page numbers or paragraph numbers.
* Citing often requires page numbers, especially in fields with long documents. HTML does not natively have page numbers or paragraph numbers.
** Project MUSE papers often have page numbers in the HTML: <nowiki>https://muse.jhu.edu</nowiki> For example:  [End Page 316] here: <nowiki>https://muse.jhu.edu/pub/50/article/781390</nowiki>
** Project MUSE papers often have page numbers in the HTML: https://muse.jhu.edu For example:  [End Page 316] here: https://muse.jhu.edu/pub/50/article/781390


=== Papers and research ===
=== Papers and research ===
Beyond the PDF
'''Beyond the PDF'''


Utopia Docs: <nowiki>https://doi.org/10.1093/bioinformatics/btq383</nowiki>
Utopia Docs: [https://doi.org/10.1371/journal.pcbi.0010034 https://doi.org/10.1093/bioinformatics/btq383]


Bourne P (2005) Will a Biological Database Be Different from a Biological Journal? PLoS Comput Biol 1(3): e34. <nowiki>https://doi.org/10.1371/journal.pcbi.0010034</nowiki>
Bourne P (2005) Will a Biological Database Be Different from a Biological Journal? PLoS Comput Biol 1(3): e34. https://doi.org/10.1371/journal.pcbi.0010034


Collaborative writing
'''Collaborative writing'''


Perkel, Jeffrey M. "Synchronized editing: the future of collaborative writing." Nature 580, no. 7801 (2020): 154-156. <nowiki>https://doi.org/10.1038/d41586-020-00916-6</nowiki>
Perkel, Jeffrey M. "Synchronized editing: the future of collaborative writing." Nature 580, no. 7801 (2020): 154-156. https://doi.org/10.1038/d41586-020-00916-6


Collaborative writing using Manubot
'''Collaborative writing using Manubot'''


Himmelstein DS, Rubinetti V, Slochower DR, Hu D, Malladi VS, et al. (2019) Open collaborative writing with Manubot. PLOS Computational Biology 15(6): e1007128. <nowiki>https://doi.org/10.1371/journal.pcbi.1007128</nowiki>
Himmelstein DS, Rubinetti V, Slochower DR, Hu D, Malladi VS, et al. (2019) Open collaborative writing with Manubot. PLOS Computational Biology 15(6): e1007128. https://doi.org/10.1371/journal.pcbi.1007128


Rando, Halie M., Simina M. Boca, Lucy D’Agostino McGowan, Daniel S. Himmelstein, Michael P. Robson, Vincent Rubinetti, Ryan Velazquez, Casey S. Greene, and Anthony Gitter. "An open-publishing response to the COVID-19 infodemic." In DISCO2021 at JCDL 2021. CEUR workshop proceedings, vol. 2976. <nowiki>https://ceur-ws.org/Vol-2976/paper-2.pdf</nowiki>
Rando, Halie M., Simina M. Boca, Lucy D’Agostino McGowan, Daniel S. Himmelstein, Michael P. Robson, Vincent Rubinetti, Ryan Velazquez, Casey S. Greene, and Anthony Gitter. "An open-publishing response to the COVID-19 infodemic." In DISCO2021 at JCDL 2021. CEUR workshop proceedings, vol. 2976. https://ceur-ws.org/Vol-2976/paper-2.pdf


Collaborative writing using other systems
'''Collaborative writing using other systems'''


Ei Pa Pa Pe-Than, Laura Dabbish, and James D. Herbsleb. 2018. Collaborative Writing on GitHub: A Case Study of a Book Project. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '18). Association for Computing Machinery, New York, NY, USA, 305–308. <nowiki>https://doi.org/10.1145/3272973.3274083</nowiki>
Ei Pa Pa Pe-Than, Laura Dabbish, and James D. Herbsleb. 2018. Collaborative Writing on GitHub: A Case Study of a Book Project. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '18). Association for Computing Machinery, New York, NY, USA, 305–308. https://doi.org/10.1145/3272973.3274083


Textbook written:
'''Textbook written:'''


<nowiki>https://github.com/HoTT/book/</nowiki>
https://github.com/HoTT/book/


=== Citation ===
=== Citation ===
Line 228: Line 228:
(sometimes using provenance vocabularies/ontologies)
(sometimes using provenance vocabularies/ontologies)


On including different points of view: Europeana 1914-1918: <nowiki>http://www.europeana1914-1918.eu/en/explore</nowiki>
On including different points of view: Europeana 1914-1918: http://www.europeana1914-1918.eu/en/explore


Polarization
[http://www.europeana1914-1918.eu/en/explore Polarization]


Shi, Feng, Misha Teplitskiy, Eamon Duede, and James A. Evans. "The wisdom of polarized crowds." Nature human behaviour 3, no. 4 (2019): 329-336.  <nowiki>https://doi.org/10.1038/s41562-019-0541-6</nowiki>
Shi, Feng, Misha Teplitskiy, Eamon Duede, and James A. Evans. "The wisdom of polarized crowds." Nature human behaviour 3, no. 4 (2019): 329-336.  https://doi.org/10.1038/s41562-019-0541-6


== Original notes ==
== Original notes ==


* https://docs.google.com/document/d/1icpvCsKiPkpxaWNRa9eOQ0j2zV1xPPRVl7G8ealRSXc/edit#
* https://docs.google.com/document/d/1icpvCsKiPkpxaWNRa9eOQ0j2zV1xPPRVl7G8ealRSXc/edit#
4

edits