wea_ondara/master
1
1
Fork 0
Code Issues Pull Requests Releases Wiki Activity

wip

Browse Source
This commit is contained in:
wea_ondara
2022-11-18 14:57:40 +01:00
parent 76018ad014
commit daddeed383
3 changed files with 21 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
text/1_intro.tex
View File

@@ -37,16 +37,11 @@ StackExchange is continually working on improving their platform. Their team imp
The \emph{Mentorship Research Project} was a research project to improve the onboarding process of new users. In the study new users who created their first question had the option the let their question be reviewed by a mentor (a user familiar with the community). The mentor world reviw the question and suggest changes to the question, for instance, more context to the question. The user would then adjust their question and post it in the community. The result of the suty was that mentored questions were received segnificantly better than non-mentored questions. Although, this is just a research project, StackExchange could create some automated system to help new users during their onboarding phase.
In August of 2018, the StackExchange team introduced a small change that may have had a huge impact on the platform. They added a new feature to visibly highlight questions from new contributors, as part of their effort to make the site more welcoming for new users\footnote{\url{https://meta.stackexchange.com/questions/314287/come-take-a-look-at-our-new-contributor-indicator}}. Specifically, members who want to answer a question created by a new contributor are shown a notification in the answer box that this question is from a new contributor. The StackExchange team hopes that this little change encourages members to be more friendly and forgiving toward new users.
% write about the change investigated
% stackexchange new contriutor post: https://meta.stackexchange.com/questions/314287/come-take-a-look-at-our-new-contributor-indicator?cb=1
% what did change intend?
This thesis evaluates whether this change has a real impact on the community and if so how the community reacts. For this analysis, this thesis uses a 2-step approach:
\begin{enumerate}
\item Gather data:
@@ -58,7 +53,7 @@ This thesis evaluates whether this change has a real impact on the community and
\item Perform an \emph{Interrupted Time Series} (ITS) analysis on the gathered data
\end{enumerate}
This thesis utilizes Vader \cite{hutto2014vader}, a sentiment analysis tool, to measure the sentiments of the answers submitted to questions of new contributors. The ITS analysis evaluates whether the change achieved its purpose of making the platform more welcoming.
Higher sentiment values, higher vote scores, and higher question count indicate better community interactions and welcomingness towards new contributors. Also, when new contributors have a good experience with their first question, they are more likely to post further questions.
Higher sentiment values, higher vote scores, and higher question count indicate more friendly community interactions and welcomingness towards new contributors. Also, when new contributors have a good experience with their first question, they are more likely to post further questions.
% how is change investigated by this thesis
% vader library

2
text/4_datasets.tex
View File

@@ -220,7 +220,7 @@ New users asked 62437 questions with an average of 1.124 questions per new user
\begin{sidewaystable}
\begin{tabularx}{\textheight}{l|rrrrrrr}
Site & Register & Active & Questions & Answers & Answer & Questions by & Questions per\\
Community & Register & Active & Questions & Answers & Answer & Questions by & Questions per\\
& users & users & & & density & new users & new user\\\hline
StackOverflow.com & 11,867,244 & 297,192 & 18,699,974 & 27,981,749 & 1.496 & 2,880,039 & 1.240\\
math.stackexchange.com & 624,671 & 17,074 & 1,170,938 & 1,565,188 & 1.336 & 265,704 & 1.336\\

19
text/7_conclusion.tex
View File

@@ -1,7 +1,26 @@
\chapter{Conclusion}
%repeat motivation
% chage is 1 of many efforts to make community better
% describe change shortly
% goal was to find out whether change improves user interaction experience for new users
% 3 criteria, sentiment, vote score, number of questions
% eval: vader -> sentiment, ITs, by looking at the 10 largest communities (list here, note so is by far the largest)
%repeat datensätze
%
%repeat results
%
%repeat discussion
%
%TODO more
The change introduced by the StackExchange team produced desired results in more than half of the investigated communities. The results of the StackOverflow community most closely resembles the expectation of improving the welcomingness. AskUbuntu, ServerFault, stats.stackexchange.com, tex.stackexchange.com, and unix.stackexchange also profit from this change. MathOverflow, SuperUser, math.stackexchange.com, and electronics.stackexchange.com do not profit as much from the change and show not an increase but decrease or continuation in the decrease of sentiment. However, the falling number of questions from new contributors stabilized a bit for the math communities and the vote score increased for electronics.stackexchange.com. SuperUser saw a huge influx of new contributors shortly after the change who asked a lot of questions and dropping the sentiment and vote score value during that period.
%sum up findings
% change did something?
%...