wea_ondara/master
1
1
Fork 0
Code Issues Pull Requests Releases Wiki Activity

wip

Browse Source
This commit is contained in:
wea_ondara
2020-03-13 13:21:02 +01:00
parent a69fa037ed
commit 8f8eab1b9a
3 changed files with 231 additions and 85 deletions
Download Patch File Download Diff File Expand all files Collapse all files

264
text/2_relwork.tex
View File

@@ -7,16 +7,21 @@
\section{Background}
StackExchange\footnote{\url{https://stackexchange.com}} is community question and anwersing (CQA) platform where users can ask and answer questions, accept answers, and up-/downvote questions and answers. StackExchange uses a community driven knowledge creation process by allowing everyone who registers to participate in the community. Invested users also get access to moderation tools to help maintain the vast community. All posts on the StackExchangeplatform are publicly visible and also accessible for web search engines allowing non-users to benefit from the community. StackExchange keeps an archive of all questions and answer posted creating a knowledge archive for future visitors to look into.
Originally, StackExchange started with StackOverflow\footnote{\url{https://stackoverflow.com}} in 2008. %TODO add ref
Since then StackExchange grew into a platform hosting sites for 174 different topics, for instance programming (StackOverflow), maths (MathOverflow\footnote{\url {https://mathoverflow.net}} and Math StackExchange\footnote{\url {https://math.stackexchange.com}}), and type setting (TeX/LaTeX\footnote{\url {https://tex.stackexchange.com}}).
Questions on StackExchange are stated in natural English language and consist of a title, body containing a detailed description of the problem or information need, and tags to categorize the question. After a question is posted the community can submit answers to the question. The author of the question can then accept an appropiate answer which satisfies their question. The accepted answers is then marked as such and shown on top of all the other answers. Questions and answers can be up-/downvoted by every user registered on the site. Votes typically represent the quality of the respective question or answer. Answers with a high score raise to the top of the answer list as answers are sorted by the vote score in descending order by default. Voting also has an influence on a user's reputation \cite{stackexchangetour, movshovitz2013analysis}. When a post (question or answers) is voted upon the reputation of the poster changes accordingly. Furthermore, downvoting an answers also decreases the reputation of the user who voted. % TODO add ref why voter also loses reputation https://stackoverflow.com/help/privileges/vote-down
Reputation on StackExchange shows how trustworthy a user is. To gain a high reputation value a user has to invest a lot of time and effort to reach a high reputation value through asking good questions and posting good answers to questions. Reputation also unlocks priviledges which may differ slightly from one community to another. %TODO ref https://stackoverflow.com/help/privileges https://mathoverflow.net/help/privileges
StackExchange\footnote{\url{https://stackexchange.com}} is community question and anwersing (CQA) platform where users can ask and answer questions, accept answers, and up-/downvote questions and answers. StackExchange uses a community driven knowledge creation process by allowing everyone who registers to participate in the community. Invested users also get access to moderation tools to help maintain the vast community. All posts on the StackExchangeplatform are publicly visible and accessible for web search engines allowing non-users to benefit from the community as well. StackExchange keeps an archive of all questions and answer posted creating a knowledge archive for future visitors to look into.
Originally, StackExchange started with StackOverflow\footnote{\url{https://stackoverflow.com}} in 2008 \cite{atwood2008stack}.
Since then StackExchange grew into a platform hosting sites for 174 different topics \cite{stackexchangetour}, for instance programming (StackOverflow), maths (MathOverflow\footnote{\url {https://mathoverflow.net}} and Math StackExchange\footnote{\url {https://math.stackexchange.com}}), and type setting (TeX/LaTeX\footnote{\url {https://tex.stackexchange.com}}).
Questions on StackExchange are stated in natural English language and consist of a title, a body containing a detailed description of the problem or information need, and tags to categorize the question. After a question is posted the community can submit answers to the question. The author of the question can then accept an appropiate answer which satisfies their question. The accepted answers is then marked as such and shown on top of all the other answers. Figure \ref{soexamplepost} shows an example of a StackOverflow question. Questions and answers can be up-/downvoted by every user registered on the site. Votes typically represent the quality of the respective question or answer. Answers with a high score raise to the top of the answer list as answers are sorted by the vote score in descending order by default. Voting also has an influence on a user's reputation \cite{stackexchangetour, movshovitz2013analysis}. When a post (question or answers) is voted upon the reputation of the poster changes accordingly. Furthermore, downvoting of answers also decreases the reputation of the user who voted \cite{stackoverflowvotedown}.
Reputation on StackExchange indicates how trustworthy a user is. To gain a high reputation value a user has to invest a lot of time and effort to reach a high reputation value through asking good questions and posting good answers to questions. Reputation also unlocks priviledges which may differ slightly from one community to another \cite{stackoverflowprivileges, mathoverflowprivileges}.
With priviledges user can, for instance, create new tags, cast votes on closing or reopening questions, or even get access to moderation tools.
StackExchange also employs a badge system to steer the community. Some badges can be obtained by performing one time actions for instance reading the tour page, %add ref
or by performing certain actions multiple times. % TODO add ref
StackExchange also employs a badge system to steer the community \cite{stackoverflowbadges}. Some badges can be obtained by performing one time actions for instance reading the tour page, or by performing certain actions multiple times, for instance, editing and answering the same question within 12 hours.
Furthermore, user can comment on every question and answer. This can be used for further clarifying and answer or a short discussion on a question or answer.
For each community on StackExchange a Meta page is offered where members of the respective community can discuss about the associated community. This place is also used by site admins to interact with the community. The Meta pages are also used for voting on new features. These Meta pages also run the same software as the CQA pages so users also vote the ideas and suggestions in same way they would do on the actual CQA sites. %TODO add ref
For each community on StackExchange a ``Meta'' page is offered where members of the respective community can discuss about the associated community \cite{stackoverflowmeta, mamykina2011design}. This place is used by site admins to interact with the community. The Meta pages are also used for proposing and voting on new features and reporting bugs. These Meta pages run the same software as the CQA pages so users vote the ideas and suggestions in same way they would do on the actual CQA sites.
\begin{figure}
\includegraphics[scale=0.5]{figures/stackoverflow_example_post}
\label{soexamplepost}
\caption{A typically question on StackOverflow. In the top middle section of the page the question is stated. The question has 4 tags an 3 comments attached to it. Beneath the question all answers are listed by score in descending order (only one answer is visible in this screenshot). The accepted answer is marked by a green check mark. To the left of the question and answers the score (computed via votes) is indicated.}
\end{figure}
% explain SO and SE in detail and how it works (https://stackexchange.com/tour)
@@ -45,6 +50,173 @@ For each community on StackExchange a Meta page is offered where members of the
\section{State of the Art}
Since the introduction of Web 2.0 and the subsquential spawning of platforms for social interaction, researchers started investigating the emerging communities.
The Social Sciences focus on the interactions of users on various platforms. Community knowledge platforms are of special intrest, for instance, StackExchange, Quora, Redit \cite{lin2017better}, Yahoo! Answers \cite{bian2008finding}, and Wikipedia \cite{yazdanian2019eliciting}. %TODO add refs
%TODO more text here
In their book on ''Building successful online communities: Evidence-based social design`` \cite{kraut2012building} Kraut \etal lie out five equally important criteria online platforms have to fullfill in order to thrive. 1) When starting a community has to have a critical mass of users who create content. \cite{mamykina2011design} %TODO add ref to stackoverflow
2) The platform must attract new users to grow as well as to replace leaving users. Depending on the type of the community new users should bring certain skills, for example, programming background in open source software, or qualtities, for example, a certain illness in medical communities. New users also bring the challenge of onboarding with them. They will not be familiar with all the rules and nuances of the community. %TODO add ref
3) Users should be encouraged to commit to the community. Online communities are often based on voluntarity of their users, hence the platform has to ensure users are willing to stay. Compared to companies, most platforms do not have contracts with users. 4) Contribution by users to the community should be encouraged. Content generation and engagment is the backbone of a online community. 5) The community need regulation to sustain the community. Not every user in a community is interested in the well being of the community. Therefore, every community has to deal with trolls, and inappropiate or even destructive behavior. Rules need to be established and enforced to limit the damage malicous users cause.
%new structure:
% list community knowledge platforms
% platforms need certian mechanisms and features to live and thrive: kraut etal
% - starting a community: critical mass, enought users to attract other users who also create content
% - attracting new users: attract new users to replace leaving ones, new users should be skilled and motivated to contribute (chanllange, depends on community some accept everyone others need specific skills (Eg OSS) or qualitities (eg illness for medical suppport groupgs, etc), mew users less commitment thatn old ones, newcommers may not behave according to community standard as they dont now them
% - encoraging commitment: willingness to stay in community (increases statisfaction, les likely to leave, better performance, more contribution), harder than in companies with employee contracts, contrast to OSS (no contract, voluntarity), greter competition from other communities in contrast to rl where options are limimted by location and distance
% - encouraging contribution: online communities need contributions by users (not lurking), content is foundation of community, contributions by users follows power law (usally, also confirmed in my results)
% - regualting behavior: maintain a funtioning community, prevent troll, inappropiate behavior, limit damage if it occurs, ease of entry & exit -> high turnover
All these criteria are heavily intertwined, so for the purposes of this thesis, these criteria can be grouped into two main categries: 1) onboaring of new users, 2) keeping users engaged, contributing, and well behaved.
\subsection{Onboarding of new users}
The onboarding process is a permanent challenge for online communities.
% One-day flies on StackOverflow \cite{slag2015one}, 1 contribution during whole registration, only user with 6 month of registration
% Eliciting New Wikipedia Users’ Interests via Automatically Mined Questionnaires: For a Warm Welcome, Not a Cold Start \cite{yazdanian2019eliciting}, cold start recommender system problem for recommending newcommers arictles to read and get a feeling for how to write articles; similar to SO because new commers
% newcomers socialization, experienced users as models/mentors, positive feedback to newcomers
% Do organizational socialization tactics influence newcomer embeddedness and turnover? \cite{allen2006organizational} #newcommers to organizations, actively embedding newcomers into organization, shows connection between socialaization and turnover (leaving the organization)
% We Don't Do That Here: How Collaborative Editing with Mentors Improves Engagement in Social Q\&A Communities \cite{ford2018we} # mentoring new commers questions (before posting), 1 month experiment, collaborative experiment with stackoverflow team, novices got a choice upon submitting a question whether or not the want feedback from a mentor regaurding the question, if so redirect to help room where mentor reviews question and suggests changes to question, mentored questions significatly better than non-mentored ones, higher scores fewer offtopic or poor questions, novices more comfortable with mentor reviewed questions
% Stack Overflow Isn't Very Welcoming: It's Time for That to Change \cite{hanlon2019stack} # passt sehr gut in die story, effort to make site more welcoming, marginalized group feel SO is a hostile and elitist place, new coders, women, people of color, etc, admitting of problem that have not been addressed (enough), mixed messages (expert site or for everyone), to little guidance for new users, pecking on new users who dont know all little things on what (not) to do (no plz and thx, low quality question -> low qualtity answer -> comments about support for low quality) or bad english, previous attempts to improve welcoming, Summer of Love (https://stackoverflow.blog/2012/07/20/kicking-off-the-summer-of-love/), The War of the Closes (https://stackoverflow.blog/2013/06/25/the-war-of-the-closes/), The NEW new “Be Nice” Policy (“Code of Conduct”) — Updated with your feedback (https://meta.stackexchange.com/questions/240839/the-new-new-be-nice-policy-code-of-conduct-updated-with-your-feedback), Mentorship Research Project - Results + Wrap-Up (https://meta.stackoverflow.com/questions/357198/mentorship-research-project-results-wrap-up?noredirect=1&lq=1) TODO also refer paper about that here, removal condesting and sarcastic comments, ideas about beginner ask page (TODO already implemted?), dont judge users for not knowing things (e.g. posting duplicates)
% Welcome Wagon: Classifying Comments on Stack Overflow \cite{silge2019welcome} #all about comment, effort to make site more welcoming
% Social Barriers Faced by Newcomers Placing Their First Contribution in Open Source Software Projects\cite{steinmacher2015social} onboarding in open source software projects, difficulties for newcomers, newcommers often on their own, barriers when 1st contributing to a project,
% Rolling out the Welcome Wagon: June Update \cite{friend2018rolling} “Ask a Question Wizard” prototype, reduce exclusion (negative feelings, expectations and experiences), improve inclusion (learn from other communities facing similar problems), classification of abusive and unwelcoming comments
% Welcome Wagon: Classifying Comments on Stack Overflow \cite{silge2019welcome} #all about comments, effort to make site more welcoming, staff internal rating of comments (fine, unwelcoming, abusive, 57 raters, 13742 ratings, 3992 comments)
\subsection{Keeping users engaged, contributing and well behaved}
% On the personality traits of stackoverflow users \cite{bazelli2013personality} analyzing personality traits, top reputated users are more extroverted than less reputated users
% reputation
% Building reputation in stackoverflow: an empirical investigation. \cite{bosu2013building} gaming the reputation system of SO, answering question with tags with lower expertise density, answering promptly, first one to answer, activity during off peak hours, contributing to diverse areas
%Analysis of the reputation system and user contributions on a question answering website: Stackoverflow \cite{movshovitz2013analysis} about the reputation system, high reputation indicates primary source of answers and high quality, most questions asked by low reputation users but high reputation users post most questions on avg compared to low reputation users, effective finding of spam users and other extreme behaviors via graph analysis, predicting which users become influential longterm contributors, experts can be reliably identified based on the participation in the first few months after registration
% Design Lessons from the Fastest Q&A Site in the West \cite{mamykina2011design} understanding SO success, 1) productive competition (gamification reputation), 2) founders were already experts on site the created (ensured success early on, founders involved in community not external), 3) meta page for discussion and voting on features (same mechanics as on SO page)
%discrimitation
% Paradise Unplugged: Identifying Barriers for Female Participation on Stack Overflow \cite{ford2016paradise} gender gap, females only 5\%, contribution barriers, found 5 gender specific (women) barriers among 14 barrier in total, barriers also affect groups like industry programmers
% Community-based production of open-source software: What do we know about the developers who participate? \cite{david2008community} only 5% women contribute to OSS
% https://insights.stackoverflow.com/survey/2019: 7.9% women, increase since 2015: 5.8%
% Gender, Representation and Online Participation: A Quantitative Study \cite{vasilescu2014gender} investigation on minorities (eg women), under representation of minorities
% Why So Few? Women in Science, Technology, Engineering, and Mathematics. \cite{hill2010so} women only 20 percent of bachelor degrees
% Women and science careers: leaky pipeline or gender filter? \cite{clark2005women} underrepresentation in STEM
% Stack Overflow Isn't Very Welcoming: It's Time for That to Change \cite{hanlon2019stack} # passt sehr gut in die story, effort to make site more welcoming, marginalized group feel SO is a hostile and elitist place, new coders, women, people of color, etc, admitting of problem that have not been addressed (enough), mixed messages (expert site or for everyone), to little guidance for new users, pecking on new users who dont know all little things on what (not) to do (no plz and thx, low quality question -> low qualtity answer -> comments about support for low quality) or bad english, previous attempts to improve welcoming, Summer of Love (https://stackoverflow.blog/2012/07/20/kicking-off-the-summer-of-love/), The War of the Closes (https://stackoverflow.blog/2013/06/25/the-war-of-the-closes/), The NEW new “Be Nice” Policy (“Code of Conduct”) — Updated with your feedback (https://meta.stackexchange.com/questions/240839/the-new-new-be-nice-policy-code-of-conduct-updated-with-your-feedback), Mentorship Research Project - Results + Wrap-Up (https://meta.stackoverflow.com/questions/357198/mentorship-research-project-results-wrap-up?noredirect=1&lq=1) TODO also refer paper about that here, removal condesting and sarcastic comments, ideas about beginner ask page (TODO already implemted?), dont judge users for not knowing things (e.g. posting duplicates)
% badge
% One Size Does Not Fit All: Badge Behavior in Q\&A Sites \cite{yanovsky2019one} # all abount badges, steering users, motivation; previous paper say that contribution increases before badge obtaining and decrases afterwards, but they find it depends on type of user: 1) users are not affected by badge system but still contribute much, 2) contribution increase ans stays the same after badge achievement 3) return to previous levels
% Can gamification motivate voluntary contributions? The case of StackOverflow Q&A community \cite{cavusoglu2015can} stimulting users to contribute via badges
% SOCIAL STATUS AND BADGE DESIGN \cite{immorlica2015social} about badges and how they create status classes, badges for every user and individual badges
% Quantifying the impact of badges on user engagement in online Q&A communities \cite{li2012quantifying} maintain consistent engagement, gamification via badges
% On the Causal Effect of Badges \cite{kusmierczyk2018causal} # all abount badges, steering users, motivation, first-time badges, first time badges steer user behavior if benefit greater then effort, otherwise no effect
% Quizz: Targeted Crowdsourcing with a Billion (Potential) Users \cite{ipeirotis2014quizz} many online comunities bysed on volutarty of users not paid workers
% Steering user behavior with badges \cite{anderson2013steering} # all abount badges, steering users, motivation, user may put in non trivial amounts of work to achieve badges -> powerful incentives, badges used in multiple ways (steer users to ask/answer more questions, voting, etc.)
% other
% Discovering Value from Community Activity on Focused Question Answering Sites: A Case Study of Stack Overflow \cite{anderson2012discovering} accepted answer strongly depends on when answers arrive, considered not only the question and accepted answer but the set of answers to a question
% Predicting the perceived quality of online mathematics contributions from users' reputations \cite{tausczik2011predicting} about mathoverflow and quality
% Predictors of Answer Quality in Online Q&A Sites cite{harper2008predictors} 1) shows that fee or expert sites are better than open qa sites (greater fee better answers), 2) big communty sites like Yahoo! Answers out perform sites which depend on experts (e.g. library refernce services) (higher answer diversity and responsiveness)
% Quizz: Targeted Crowdsourcing with a Billion (Potential) Users \cite{ipeirotis2014quizz} many online comunities bysed on volutarty of users not paid workers
% Design Lessons from the Fastest Q&A Site in the West \cite{mamykina2011design} understanding SO success, 1) productive competition (gamification reputation), 2) founders were already experts on site the created (ensured success early on, founders involved in community not external), 3) meta page for discussion and voting on features (same mechanics as on SO page)
% How Do Programmers Ask and Answer Questions on the Web? \cite{treude2011programmers} qa sites very effective at code review and conceptual questions
% The role of knowledge in software development \cite{robillard1999role} people have different areas of knowledge and expertise
% Finding the Right Facts in the Crowd: Factoid Question Answering over Social Media \cite{bian2008finding}, about Yahoo! Answers, finding factual answers by using available data on user interaction
% No Country for Old Members: User Lifecycle and Linguistic Change in Online Communities \cite{danescu2013no}
% Better When It Was Smaller? Community Content and Behavior After Massive Growth \cite{lin2017better}, defaulting of subreddit, quality remains high, dip in upvotes directly after defaulting but recover quickly and get even higher than before, complaints about low-quality content do not increase, language stays the same, however community clusters among fewer posts than before defaulting
% Non-public and public online community participation: Needs, attitudes and behavior \cite{nonnecke2006non} about lurking, many programmers do that probably, not even registering, lurking not a bad behavior but observing, lurkers are more introverted, passive behavior, less optimistic and positive than posters, prviously lurking was thought of free riding, not contributing, taking not giving to comunity, important for getting to know a community, better integration when joining
% A comprehensive survey and classification of approaches for community question answering \cite{srba2016comprehensive}, meta study on papers published between 2005 and 2014
%paper links bekommen:
%tutorial: Bernal et al. \cite{bernal2017interrupted}
%You Can’t Stay Here: The Efficacy of Reddit’s 2015 Ban Examined Through Hate Speech \cite{chandrasekharan2017you}
% -> reddit hate community ban: change = ban
% -> todo
%literature
% Tracing Community Genealogy: How New Communities Emerge from the Old \cite{tan2018tracing}
% On the personality traits of stackoverflow users \cite{bazelli2013personality} analyzing personality traits, top reputated users are more extroverted than less reputated users
% -> gute vorlage http://softwareprocess.es/pubs/bazelli2013ICSMERA-Personality.pdf
% <- One-day flies on StackOverflow \cite{slag2015one}, 1 contribution during whole registration, only user with 6 month of registration
% -> [1] Discovering Value from Community Activity on Focused Question Answering Sites: A Case Study of Stack Overflow \cite{anderson2012discovering} accepted answer strongly depends on when answers arrive, considered not only the question and accepted answer but the set of answers to a question
% -> [23] Predicting the perceived quality of online mathematics contributions from users' reputations \cite{tausczik2011predicting} about mathoverflow and quality
% -> [4] Predictors of Answer Quality in Online Q&A Sites cite{harper2008predictors} 1) shows that fee or expert sites are better than open qa sites (greater fee better answers), 2) big communty sites like Yahoo! Answers out perform sites which depend on experts (e.g. library refernce services) (higher answer diversity and responsiveness)
% -> todo done
% -> todo done
% -> contains generic refernces to boost ref count
% -> [5] Building reputation in stackoverflow: an empirical investigation. \cite{bosu2013building} gaming the reputation system of SO, answering question with tags with lower expertise density, answering promptly, first one to answer, activity during off peak hours, contributing to diverse areas
% -> [8] Analysis of the reputation system and user contributions on a question answering website: Stackoverflow \cite{movshovitz2013analysis} about the reputation system, high reputation indicates primary source of answers and high quality, most questions asked by low reputation users but high reputation users post most questions on avg compared to low reputation users, effective finding of spam users and other extreme behaviors via graph analysis, predicting which users become influential longterm contributors, experts can be reliably identified based on the participation in the first few months after registration
% -> todo done
% -> [1] Design Lessons from the Fastest Q&A Site in the West \cite{mamykina2011design} understanding SO success, 1) productive competition (gamification reputation), 2) founders were already experts on site the created (ensured success early on, founders involved in community not external), 3) meta page for discussion and voting on features (same mechanics as on SO page)
% -> [2] How Do Programmers Ask and Answer Questions on the Web? \cite{treude2011programmers} qa sites very effective at code review and conceptual questions
% -> [10] The role of knowledge in software development \cite{robillard1999role} people have different areas of knowledge and expertise
% -> [3] Finding the Right Facts in the Crowd: Factoid Question Answering over Social Media \cite{bian2008finding}, about Yahoo! Answers, finding factual answers by using available data on user interaction
% No Country for Old Members: User Lifecycle and Linguistic Change in Online Communities \cite{danescu2013no}
% Better When It Was Smaller? Community Content and Behavior After Massive Growth \cite{lin2017better}, defaulting of subreddit, quality remains high, dip in upvotes directly after defaulting but recover quickly and get even higher than before, complaints about low-quality content do not increase, language stays the same, however community clusters among fewer posts than before defaulting
% -> breaching community norms (kraut 2012)
% starting a community: critical mass, enought users to attract other users who also create content
% attracting new users: attract new users to replace leaving ones, new users should be skilled and motivated to contribute (chanllange, depends on community some accept everyone others need specific skills (Eg OSS) or qualitities (eg illness for medical suppport groupgs, etc), mew users less commitment thatn old ones, newcommers may not behave according to community standard as they dont now them
% encoraging commitment: willingness to stay in community (increases statisfaction, les likely to leave, better performance, more contribution), harder than in companies with employee contracts, contrast to OSS (no contract, voluntarity), greter competition from other communities in contrast to rl where options are limimted by location and distance
% encouraging contribution: online communities need contributions by users (not lurking), content is foundation of community, contributions by users follows power law (usally, also confirmed in my results)
% regualting behavior: maintain a funtioning community, prevent troll, inappropiate behavior, limit damage if it occurs, ease of entry & exit -> high turnover
% -> lowering content quality (Gorbatai 2011) %TODO read and add to list of notizen
% Eliciting New Wikipedia Users’ Interests via Automatically Mined Questionnaires: For a Warm Welcome, Not a Cold Start \cite{yazdanian2019eliciting}
% -> cold start recommender system problem for recommending newcommers articles to read and get a feeling for how to write articles; similar to SO because new commers don't know the rules so well; familiarize newcommers with how things work on the site, onboarding
% Do organizational socialization tactics influence newcomer embeddedness and turnover? \cite{allen2006organizational} #newcommers to organizations, actively embedding newcomers into organization, shows connection between socialaization and turnover (leaving the organization)
% -> todo
% We Don't Do That Here: How Collaborative Editing with Mentors Improves Engagement in Social Q\&A Communities \cite{ford2018we} # mentoring new commers questions (before posting), 1 month experiment, collaborative experiment with stackoverflow team, novices got a choice upon submitting a question whether or not the want feedback from a mentor regaurding the question, if so redirect to help room where mentor reviews question and suggests changes to question, mentored questions significatly better than non-mentored ones, higher scores fewer offtopic or poor questions, novices more comfortable with mentor reviewed questions
% -> todo
% -> Non-public and public online community participation: Needs, attitudes and behavior \cite{nonnecke2006non} about lurking, many programmers do that probably, not even registering, lurking not a bad behavior but observing, lurkers are more introverted, passive behavior, less optimistic and positive than posters, prviously lurking was thought of free riding, not contributing, taking not giving to comunity, important for getting to know a community, better integration when joining
% -> Social Barriers Faced by Newcomers Placing Their First Contribution in Open Source Software Projects\cite{steinmacher2015social} onboarding in open source software projects, difficulties for newcomers, newcommers often on their own, barriers when 1st contributing to a project,
% -> Paradise Unplugged: Identifying Barriers for Female Participation on Stack Overflow \cite{ford2016paradise} gender gap, females only 5%, contribution barriers, found 5 gender specific (women) barriers among 14 barrier in total, barriers also affect groups like industry programmers
% -> Community-based production of open-source software: What do we know about the developers who participate? \cite{david2008community} only 5% women contribute to OSS
% -> https://insights.stackoverflow.com/survey/2019: 7.9% women, increase since 2015: 5.8%
% -> Gender, Representation and Online Participation: A Quantitative Study \cite{vasilescu2014gender} investigation on minorities (eg women), under representation of minorities
% -> Why So Few? Women in Science, Technology, Engineering, and Mathematics. \cite{hill2010so} women only 20 percent of bachelor degrees
% -> Women and science careers: leaky pipeline or gender filter? \cite{clark2005women} underrepresentation in STEM
% Stack Overflow Isn't Very Welcoming: It's Time for That to Change \cite{hanlon2019stack} # passt sehr gut in die story, effort to make site more welcoming
% -> marginalized group feel SO is a hostile and elitist place, new coders, women, people of color, etc
% -> admitting of problem that have not been addressed (enough), mixed messages (expert site or for everyone), to little guidance for new users, pecking on new users who dont know all little things on what (not) to do (no plz and thx, low quality question -> low qualtity answer -> comments about support for low quality) or bad english, previous attempts to improve welcoming, Summer of Love (https://stackoverflow.blog/2012/07/20/kicking-off-the-summer-of-love/), The War of the Closes (https://stackoverflow.blog/2013/06/25/the-war-of-the-closes/), The NEW new “Be Nice” Policy (“Code of Conduct”) — Updated with your feedback (https://meta.stackexchange.com/questions/240839/the-new-new-be-nice-policy-code-of-conduct-updated-with-your-feedback), Mentorship Research Project - Results + Wrap-Up (https://meta.stackoverflow.com/questions/357198/mentorship-research-project-results-wrap-up?noredirect=1&lq=1) TODO also refer paper about that here, removal condesting and sarcastic comments, ideas about beginner ask page (TODO already implemted?), dont judge users for not knowing things (e.g. posting duplicates)
% Rolling out the Welcome Wagon: June Update \cite{friend2018rolling} “Ask a Question Wizard” prototype, reduce exclusion (negative feelings, expectations and experiences), improve inclusion (learn from other communities facing similar problems), classification of abusive and unwelcoming comments
% Welcome Wagon: Classifying Comments on Stack Overflow \cite{silge2019welcome} #all about comments, effort to make site more welcoming, staff internal rating of comments (fine, unwelcoming, abusive, 57 raters, 13742 ratings, 3992 comments)
% One Size Does Not Fit All: Badge Behavior in Q\&A Sites \cite{yanovsky2019one} # all abount badges, steering users, motivation; previous paper say that contribution increases before badge obtaining and decrases afterwards, but they find it depends on type of user: 1) users are not affected by badge system but still contribute much, 2) contribution increase ans stays the same after badge achievement 3) return to previous levels
% -> todo
% -> []Can gamification motivate voluntary contributions? The case of StackOverflow Q&A community \cite{cavusoglu2015can} stimulting users to contribute via badges
% -> []SOCIAL STATUS AND BADGE DESIGN \cite{immorlica2015social} about badges and how they create status classes, badges for every user and individual badges
% -> []Quantifying the impact of badges on user engagement in online Q&A communities \cite{li2012quantifying} maintain consistent engagement, gamification via badges
% On the Causal Effect of Badges \cite{kusmierczyk2018causal} # all abount badges, steering users, motivation, first-time badges, first time badges steer user behavior if benefit greater then effort, otherwise no effect
% -> [] Quizz: Targeted Crowdsourcing with a Billion (Potential) Users \cite{ipeirotis2014quizz} many online comunities bysed on volutarty of users not paid workers
% -> todo
% Steering user behavior with badges \cite{anderson2013steering} # all abount badges, steering users, motivation, user may put in non trivial amounts of work to achieve badges -> powerful incentives, badges used in multiple ways (steer users to ask/answer more questions, voting, etc.)
% -> todo
% A comprehensive survey and classification of approaches for community question answering \cite{srba2016comprehensive}, meta study on papers published between 2005 and 2014
%literatur analyse todo
%paper lesen und sachen rausschreiben; keywords ...
%struktur neu machen
%schreiben
% old
%structure
%- various research on collaborative online communities, yahoo answers, stackoverflow/exchange, quora, wikipedia, ...
% - A comprehensive survey and classification of approaches for community question answering \cite{srba2016comprehensive} # good description of SO
@@ -92,79 +264,3 @@ For each community on StackExchange a Meta page is offered where members of the
% -> prevent 1 day flies
% -> keep new users engaged
% 2 problems: onboarding and keeping users active (eg badges)
%paper links bekommen:
%tutorial: Bernal et al. \cite{bernal2017interrupted}
%You Can’t Stay Here: The Efficacy of Reddit’s 2015 Ban Examined Through Hate Speech \cite{chandrasekharan2017you}
% -> reddit hate community ban: change = ban
% -> todo
%literature
% Tracing Community Genealogy: How New Communities Emerge from the Old \cite{tan2018tracing}
% On the personality traits of stackoverflow users \cite{bazelli2013personality} analyzing personality traits, top reputated users are more extroverted than less reputated users
% -> gute vorlage http://softwareprocess.es/pubs/bazelli2013ICSMERA-Personality.pdf
% <- One-day flies on StackOverflow \cite{slag2015one}, 1 contribution during whole registration, only user with 6 month of registration
% -> [1] Discovering Value from Community Activity on Focused Question Answering Sites: A Case Study of Stack Overflow \cite{anderson2012discovering} accepted answer strongly depends on when answers arrive, considered not only the question and accepted answer but the set of answers to a question
% -> [23] Predicting the perceived quality of online mathematics contributions from users' reputations \cite{tausczik2011predicting} about mathoverflow and quality
% -> [4] Predictors of Answer Quality in Online Q&A Sites cite{harper2008predictors} 1) shows that fee or expert sites are better than open qa sites (greater fee better answers), 2) big communty sites like Yahoo! Answers out perform sites which depend on experts (e.g. library refernce services) (higher answer diversity and responsiveness)
% -> todo done
% -> todo done
% -> contains generic refernces to boost ref count
% -> [5] Building reputation in stackoverflow: an empirical investigation. \cite{bosu2013building} gaming the reputation system of SO, answering question with tags with lower expertise density, answering promptly, first one to answer, activity during off peak hours, contributing to diverse areas
% -> [8] Analysis of the reputation system and user contributions on a question answering website: Stackoverflow \cite{movshovitz2013analysis} about the reputation system, high reputation indicates primary source of answers and high quality, most questions asked by low reputation users but high reputation users post most questions on avg compared to low reputation users, effective finding of spam users and other extreme behaviors via graph analysis, predicting which users become influential longterm contributors, experts can be reliably identified based on the participation in the first few months after registration
% -> todo done
% -> [1] Design Lessons from the Fastest Q&A Site in the West \cite{mamykina2011design} understanding SO success, 1) productive competition (gamification reputation), 2) founders were already experts on site the created (ensured success early on, founders involved in community not external), 3) meta page for discussion and voting on features (same mechanics as on SO page)
% -> [2] How Do Programmers Ask and Answer Questions on the Web? \cite{treude2011programmers} qa sites very effective at code review and conceptual questions
% -> [10] The role of knowledge in software development \cite{robillard1999role} people have different areas of knowledge and expertise
% -> [3] Finding the Right Facts in the Crowd: Factoid Question Answering over Social Media \cite{bian2008finding}, about Yahoo! Answers, finding factual answers by using available data on user interaction
% No Country for Old Members: User Lifecycle and Linguistic Change in Online Communities \cite{danescu2013no}
% Better When It Was Smaller? Community Content and Behavior After Massive Growth \cite{lin2017better}, defaulting of subreddit, quality remains high, dip in upvotes directly after defaulting but recover quickly and get even higher than before, complaints about low-quality content do not increase, language stays the same, however community clusters among fewer posts than before defaulting
% -> breaching community norms (kraut 2012)
% starting a community: critical mass, enought users to attract other users who also create content
% attracting new users: attract new users to replace leaving ones, new users should be skilled and motivated to contribute (chanllange, depends on community some accept everyone others need specific skills (Eg OSS) or qualitities (eg illness for medical suppport groupgs, etc), mew users less commitment thatn old ones, newcommers may not behave according to community standard as they dont now them
% encoraging commitment: willingness to stay in community (increases statisfaction, les likely to leave, better performance, more contribution), harder than in companies with employee contracts, contrast to OSS (no contract, voluntarity), greter competition from other communities in contrast to rl where options are limimted by location and distance
% encouraging contribution: online communities need contributions by users (not lurking), content is foundation of community, contributions by users follows power law (usally, also confirmed in my results)
% regualting behavior: maintain a funtioning community, prevent troll, inappropiate behavior, limit damage if it occurs, ease of entry & exit -> high turnover
% -> lowering content quality (Gorbatai 2011)
% Eliciting New Wikipedia Users’ Interests via Automatically Mined Questionnaires: For a Warm Welcome, Not a Cold Start \cite{yazdanian2019eliciting}
% -> cold start recommender system problem for recommending newcommers articles to read and get a feeling for how to write articles; similar to SO because new commers don't know the rules so well; familiarize newcommers with how things work on the site, onboarding
% Do organizational socialization tactics influence newcomer embeddedness and turnover? \cite{allen2006organizational} #newcommers to organizations, actively embedding newcomers into organization, shows connection between socialaization and turnover (leaving the organization)
% -> todo
% We Don't Do That Here: How Collaborative Editing with Mentors Improves Engagement in Social Q\&A Communities \cite{ford2018we} # mentoring new commers questions (before posting), 1 month experiment, collaborative experiment with stackoverflow team, novices got a choice upon submitting a question whether or not the want feedback from a mentor regaurding the question, if so redirect to help room where mentor reviews question and suggests changes to question, mentored questions significatly better than non-mentored ones, higher scores fewer offtopic or poor questions, novices more comfortable with mentor reviewed questions
% -> todo
% -> Non-public and public online community participation: Needs, attitudes and behavior \cite{nonnecke2006non} about lurking, many programmers do that probably, not even registering, lurking not a bad behavior but observing, lurkers are more introverted, passive behavior, less optimistic and positive than posters, prviously lurking was thought of free riding, not contributing, taking not giving to comunity, important for getting to know a community, better integration when joining
% -> Social Barriers Faced by Newcomers Placing Their First Contribution in Open Source Software Projects\cite{steinmacher2015social} onboarding in open source software projects, difficulties for newcomers, newcommers often on their own, barriers when 1st contributing to a project,
% -> Paradise Unplugged: Identifying Barriers for Female Participation on Stack Overflow \cite{ford2016paradise} gender gap, females only 5%, contribution barriers, found 5 gender specific (women) barriers among 14 barrier in total, barriers also affect groups like industry programmers
% -> Community-based production of open-source software: What do we know about the developers who participate? \cite{david2008community} only 5% women contribute to OSS
% -> https://insights.stackoverflow.com/survey/2019: 7.9% women, increase since 2015: 5.8%
% -> Gender, Representation and Online Participation: A Quantitative Study \cite{vasilescu2014gender} investigation on minorities (eg women), under representation of minorities
% -> Why So Few? Women in Science, Technology, Engineering, and Mathematics. \cite{hill2010so} women only 20 percent of bachelor degrees
% -> Women and science careers: leaky pipeline or gender filter? \cite{clark2005women} underrepresentation in STEM
% Stack Overflow Isn't Very Welcoming: It's Time for That to Change \cite{hanlon2019stack} # passt sehr gut in die story, effort to make site more welcoming
% -> todo
% -> marginalized group feel SO is a hostile and elitist place, new coders, women, people of color, etc
% -> admitting of problem that have not been addressed (enough), mixed messages (expert site or for everyone), to little guidance for new users, pecking on new users who dont know all little things on what (not) to do (no plz and thx, low quality question -> low qualtity answer -> comments about support for low quality) or bad english, previous attempts to improve welcoming, Summer of Love (https://stackoverflow.blog/2012/07/20/kicking-off-the-summer-of-love/), The War of the Closes (https://stackoverflow.blog/2013/06/25/the-war-of-the-closes/), The NEW new “Be Nice” Policy (“Code of Conduct”) — Updated with your feedback (https://meta.stackexchange.com/questions/240839/the-new-new-be-nice-policy-code-of-conduct-updated-with-your-feedback), Mentorship Research Project - Results + Wrap-Up (https://meta.stackoverflow.com/questions/357198/mentorship-research-project-results-wrap-up?noredirect=1&lq=1) TODO also refer paper about that here, removal condesting and sarcastic comments, ideas about beginner ask page (TODO already implemted?), dont judge users for not knowing things (e.g. posting duplicates)
% Rolling out the Welcome Wagon: June Update \cite{friend2018rolling} “Ask a Question Wizard” prototype, reduce exclusion (negative feelings, expectations and experiences), improve inclusion (learn from other communities facing similar problems), classification of abusive and unwelcoming comments
% Welcome Wagon: Classifying Comments on Stack Overflow \cite{silge2019welcome} #all about comments, effort to make site more welcoming, staff internal rating of comments (fine, unwelcoming, abusive, 57 raters, 13742 ratings, 3992 comments)
% -> todo
% One Size Does Not Fit All: Badge Behavior in Q\&A Sites \cite{yanovsky2019one} # all abount badges, steering users, motivation
% -> todo
% -> Can gamification motivate voluntary contributions? The case of StackOverflow Q&A community \cite{cavusoglu2015can} stimulting users to contribute via badges
% -> SOCIAL STATUS AND BADGE DESIGN \cite{immorlica2015social} about badges and how they create status classes, badges for every user and individual badges
% -> Quantifying the impact of badges on user engagement in online Q&A communities \cite{li2012quantifying} maintain consistent engagement, gamification via badges
% On the Causal Effect of Badges \cite{kusmierczyk2018causal} # all abount badges, steering users, motivation, first-time badges, first time badges steer user behavior if benefit greater then effort, otherwise no effect
% -> todo
% Steering user behavior with badges \cite{anderson2013steering} # all abount badges, steering users, motivation, user may put in non trivial amounts of work to achieve badges -> powerful incentives, badges used in multiple ways (steer users to ask/answer more questions, voting, etc.)
% -> todo
% A comprehensive survey and classification of approaches for community question answering \cite{srba2016comprehensive} # good description of SO
% -> todo
% -> meta study on papers published between 2005 and 2014
%literatur analyse todo
%paper lesen und sachen rausschreiben; keywords ...
%struktur neu machen
%schreiben

51
text/bib.bib
View File

@@ -143,6 +143,12 @@
booktitle={CHI},
year={2018}
}
@article{atwood2008stack,
title={Stack Overflow Private Beta Begins},
author={Atwood, Jeff},
journal={\url{https://stackoverflow.blog/2008/01/}\newline\url{01/stack-overflow-private-beta-begins/}},
year={2008}
}
@article{hanlon2019stack,
title={Stack Overflow Isn't Very Welcoming: It's Time for That to Change},
author={Hanlon, Jay},
@@ -165,7 +171,37 @@
title={Tour - StackExchange},
author={},
journal={\url{https://stackexchange.com/tour}},
year={2019}
year={}
}
@article{stackoverflowvotedown,
title={Help Center > Privileges > Vote down},
author={},
journal={\url{https://stackoverflow.com/help/privileges/vote-down}},
year={}
}
@article{stackoverflowprivileges,
title={Help Center > Privileges},
author={},
journal={\url{https://stackoverflow.com/help/privileges/}},
year={}
}
@article{mathoverflowprivileges,
title={Help Center > Privileges},
author={},
journal={\url{https://mathoverflow.com/help/privileges/}},
year={}
}
@article{stackoverflowbadges,
title={Help Center > Badges},
author={},
journal={\url{https://stackoverflow.com/help/badges/}},
year={}
}
@article{stackoverflowmeta,
title={What is "meta"? How does it work?},
author={},
journal={\url{https://stackoverflow.com/help/whats-meta/}},
year={}
}
@inproceedings{yanovsky2019one,
title={One Size Does Not Fit All: Badge Behavior in Q\&A Sites},
@@ -274,3 +310,16 @@
year={2005},
publisher={Taylor \& Francis}
}
@book{kraut2012building,
title={Building successful online communities: Evidence-based social design},
author={Kraut, Robert E and Resnick, Paul},
year={2012},
publisher={Mit Press}
}
@inproceedings{ipeirotis2014quizz,
title={Quizz: targeted crowdsourcing with a billion (potential) users},
author={Ipeirotis, Panagiotis G and Gabrilovich, Evgeniy},
booktitle={Proceedings of the 23rd international conference on World wide web},
pages={143--154},
year={2014}
}

1
text/main.tex
View File

@@ -195,6 +195,7 @@
%% ... it's OK to put here your own newcommand/newenvironment-definitions ...
\newcommand{\etal}{et~al.~}