Barriers to Quality at Wikipedia (and potentially other Wiki projects)
Barriers to Quality at Wikipedia (and potentially other Wiki projects)
- Starting point
- Warning: Long thread ahead!
Bhneihouse posted a description of her framework, which she titled "Barriers to Quality" (details).
Summary:
- Narrow demographics of communities probably leads to an imbalance in project coverage (both information demand and overall quality content)
- Quality users become disappointed and leave
- Rude behaviour of other users
- Technical, "political" and informational elitism may have a discouraging effect on less active or technically adept users, partly due to models of policy- and maintenance-driven approaches.
- Status is defined by quantity, not quality of contributions.
- Quantity and rapidity of posting dominates discussions, rather than the quality of points made
- Software toolset is limited, user-unfriendly and discouraging
- Quality of content erodes in a manner related to community size ("content erosion")
Positives related to Wikipedia culture:
- Everyone welcome
- Anyone can start anywhere
- No prior expertise needed, just an (encouraged) ability to put together good evidence
- Personal opinions trumped by facts and evidence
- Hard work or minimal participation valued
- No "sacred cows" in content areas
- Everyone online can benefit
- Seeks to "do good"
Negatives related to Wikipedia culture:
- Everyone is welcome even if badly behaved; hence problem users return, some users become adept at gaming the system
- Significant content can be wiped out, as if it didn't matter. If restored (questionable) that also takes time
- Technically skilled people can gain more control; technical and logical and "Picking apart arguments" can trump everything else
- Focus on value of contributions rather than "just being part of the community" (and conversely users who don't contribute are not part of the community)
- Award system rewards and recognition needed to "move up in the chain of responsibility" (however recognition is often not provided via a balanced objective or consensus approach)
- Some disruptive behaviours are allowed or hard to eradicate - infighting, flaming, vandalism, reactive responses, picking apart arguments without personally checking facts, forcing users to defend knowledge (often against people with limited knowledge or an agenda)
- Civility issues have a number of flavours where the user is civil but..... (tendentious, intentionally or recklessly makes untruthful statements, wants Wikipedia to be something it isn't, seeks control by exhausting others, "travels with a pack of like-minded editors who can overpower an article or discussion")
- Even if the problem editor is addressed the harm they have done to the community (other users) or content is hard to repair
Toolset issues:
- Poorly suited for the job
- Clunky, linear, coding involved, not user friendly, hard for newcomers, impedes contribution
- Limited
- Media linked across projects, unreasonably constrained, cannot replicate other websites
- All communication requires writing
- Slow and cumbersome, omits other communications (body language, expressions, voice tone, etc) -- however does ensure documentation.
Information issues:
- Not well rounded by topic or language
- How should coverage vary by language, should all languages have the same kind of coverage, how to determine focus areas, known to be big gaps in coverage, but how to identify these?
- How does Wikipedia ask its users what else they need (or want) on Wikipedia
- Users may have ideas they lack skill or knowledge to create pages for
- How to reach a younger audience and get them involved in creation/ideas?
Overall recommendations:
- Wikipedia is at a crossroads
- Needs to decide its brand (and what it's doing, and how it's doing it), take a "hard look" at how it's been operating and what does or doesn't work.
- Consistent with that, all policies and approaches must be brought into line with that brand (not just lip service), and Wikipedia needs to lead by example.
- To be a world encyclopedia means reaching people who are offline, gaining a more diverse contributor base, and being more balanced and rounded in information coverage
- May involve furnishing computers to people and areas who can't get access
- Younger users need to be brought into the contributing circle
- Minors (children) need knowledge (eg for quality of life, self-betterment, education, etc). Early user involvement teaches them how to use and contribute, they can master the learning curve early, will naturally help and show others how to benefit (eg older people). Also provides safe ways to learn valuable life-skills.
- Wikipedia needs to show by example
- "Gold standard of collaboration"
- Rules and policies need to be forged that make it a safe place to collaborate (and learn how to collaborate) but also improves overall culture via knowledge and skills
- General discussion - scope and remit of Quality Taskforce
FT2 felt this explained Bhneihouse's outlook better, and observed that the umbrella topic of "Quality" split into overlapping areas of external (reader/researcher) quality, internal (editor) quality, perception of quality (what impacts the perception of quality by readers and the media), project quality (overall quality of the project), and objectively what we feel quality should cover. He understood the core remit of the team as "quality of content". A wider focus might be difficult to cover in the time allowed.
Bhneihouse liked the idea of catgorizing quality but felt the overall framework was important; no formal statement said only to look at one part of quality. [We asked about this, see below]. She felt that a framework like this was crucial:
- "I want to address what is standing in the way of making Wikipedia what it wants to be because that is the ultimate quality issue.... Then I would like for us to craft a set of recommendations... craft specific "fixes" for problem areas, for example: identifying what teenage girls want on Wikipedia, what kind of tools they might want/need to utilize and crafting a Wikipedia in the Schools program to expose kids to engaging in learning on Wikipedia."
- "All of this is going to drive new inroads... For example: while rules and policies need to be consistent, there may be a different mentoring/rule approach to teen centered content or teen users/contributors. They may get a bit more oversight until they get the hang of how they should appropriately contribute.
- For self identified technophobes, we may have a mentoring/wizard approach that allows them to do very little other than type and choose something graphically, and those people may need editors who look at the content/wikis for different things such as obvious newbie non tech types of mistakes. [This is] how defining who and what you are, and what your purpose is drives actions... it is those actions that create or negate quality on Wikipedia."
- Clarification of taskforce focus
FT2 felt if this degree of uncertainty existed, there was an urgent need to check the remit with with the strategy team. He distinguished quality of content as a sub-topic within quality of project, and suggested these should not be conflated; perhaps setting up a second taskforce to look at the other was best.
Woodwalker concurred in requesting clear guidance on this point.
On asking (email) The taskforce was informed that content quality was intended to be the core focus. However this did not preclude looking at other aspects which was encouraged as well.
- General discussion
Sue Gardner strongly supported this thread.
Randomran felt it was "fantastic".
FT2 suggested he might try to do similar for "quality of content".
Bhneihouse suggested a "quality related to wiki-culture" subtopic as well ("addressing making the culture more amenable to new users and offsetting its deficits"), noting all of these would dovetail into quality in the end.
FT2 wrote up a summary of content quality at Task force/Wikipedia Quality/Content quality (discussed separately).
Woodwalker commented on Bhneihouse's final recommendations, agreeing with almost all, with a question over "providing computers to people lacking them" which was a nice ideal but probably untenable for serious impact as a current target.
Bhneihouse responded with further comments (details). Notable points:
- "This is a long term project. There is a lot of information in the world. The Guttenberg project has something similar going on with literature and from seeing their results I know that this is doable. Perhaps we need to section topic areas off and try to fill in a bit of each and then more of each and then…until those topic areas are better populated. I think this is an area worth discussion - how to approach more comprehensive content - as appropriate for a quality team. Breadth of content creates better quality."
- "[I want] Wikipedia to be [a] host for working groups for school and university kids. Why not a Wikipedia style "wave"? and Wiki groups? (of course once we get more basic issues under better control.)"
- "Some of my prof[essor]s won't allow us to discuss our grades on a test or a paper for 24 hours so we really think about what it is they have "said" and what we really want to say ... People who regularly can be shown to not actually read content yet react to it can eventually get a negative rating score of some sort...
- Teaching people the power of forgiveness, of flexibility, of all the tools they need to be good collaborators is truly KEY if Wikipedia is going to exist in ten years. This how we become the gold standard - by teaching. If knowledge is power then those who teach are truly great. We teach others what we know about how to work together. We figure it out, we define it, we create wizards, we create videos, we do whatever it is we need to do to ensure that people can learn what it is they need to know to participate. And we remove barriers to participation."
- "[T]his is why Wikipedia is powerful. I think it may be possible to challenge the existing community to be teachers. I think there may be a myriad of ways to entice them to play by rules not of their own making to create a just result. We just haven't explored them all. So while we are adding to the community, we can also heal the community. Each of us has a teacher inside of us".
Woodwalker commented:
- Lists could be made of missing material for specific areas of expertise. Some knowledge is universal. This would help smaller projects and guide new users where content would be useful.
- Disagrees with blocking as a norm unless there is clear bad intent. Prefers deal-making ("don't do X or this will happen"): "Most of these well-intending problematic users can become good contributors when they just have a little less freedom/choice where and when to edit. The most surprising aspect to me is that many of them were afterwards thankful".
- "Editing Wikipedia shouldn't be a matter of simply signing in and then having total freedom, it should be a learning process that only begins with signing in. I understand this doesn't seem compatible with the liberal ideals and mentality of the founders and many of the current incrowd of Wikipedia, yet I think this is a misconception. I think guiding contributors to more constructive ways is in a way even more compatible with our ideals than the total freedom to behave, edit and do as you like we have now."
- "[Everyone agrees] something has to be done about behaviour. The question is mainly how to convince the communities and how to make a recommendation that will have impact."
Piotrus noted the point about " disruptive behaviours being allowed", adding that there is an increasingly poisonous atmosphere due to failue to effectively address flaming, harassment, etc.
- Accepting there is a need for substantive change
Bhneihouse felt that:
- "[T]he community itself needs to radically change, it needs to diversify, it needs to feel empowered to police itself and it needs to have policies and guidelines in place that support the community members in acting correctly in the first place and empowers them to police themselves... it is tricky when the body that is "voting" is the one causing the problems... it was a small group that originally got [Wikipedia] started. If something external needed to rein it in and reshape it in order for it to become what it was originally intended to be, that might not be a bad thing".
- "[T]he demographics I see at Wikipedia are a bit like an implosion waiting to happen. If something doesn't change, Wikipedia has the potential to be the best idea with the worst implementation people ever heard of. Sometimes, we give up some of our "freedoms" i.e. the freedom for every user to have a say in every decision, in order to get what we wanted in the first place.
- I fear that many Wikipedians aren't willing to engage in trade offs.... All of us have seen people with the wrong mindset destroy projects with great potential. We have a choice. We figure out how to fix it and make it better for a lot of other people, in this case, billions of people; or we say it's too difficult to make it work".
FT2 supported this view. Woodwalker felt it was "too pessimistic" and that rating talk edits could "probably" solve conduct issues by social pressure.
- User conduct
Bhneihouse drew attention to comments about IP editing and similar pages, to shed light on past proposals tried or rejected.
Woodwalker stated he was saddened due to a current wiki-dispute:
- "[W]hat I can't stand is people being too stupid to understand what a discussion is about yet contributing in those discussions in an often aggressive, personally directed and provocative way. I can't stand to be framed every time, being called names even after leaving a discussion... I think it's the idiots that can't communicate in a constructive way we should worry about, not the IPs. As I said, vandalism is probably not the worst problem for quality, the worst problem is wide-spread ignorance combined with self-over-estimation among the most active users."
Randomran felt there were too many users who were "opinionated AND[/OR] self-serving", noting "there's no downside to being opinionated and self-serving so long as you can find a few passive aggressive people to support and protect you".
Bhneihouse felt that including wider demographics would cause more people with "good" motivations to join and that "empowering [administrators] to be vocal, to teach, to ban on actionable offenses, etc. will start to change the culture to 'this behavior is not tolerated'."
Randomran noted the actionable issues were fine, it was the unactionable offenses (passive agrgressive, claims a user was not attacking but stating a firm point, ongoing borderline behaviour that doesn't formally cross a line, "fellow travelling team" support) that are the problem.
Bhneihouse felt insults should be met by a warning and a "respect" culture implemented ("I didn't cross the line" doesn't carry weight if disrespectful). Supporters of poor conduct should face the same result as the conduct they sponsored. Users who don't wish to be part of a well behaved culture get told their access will be moderated.
- "In a short time Wikipedia can go from a community where many seem to not respect anyone to a community where people know there are rules and policies they must abide by... Perhaps it is time to stop supporting anarchy and time to make the community responsible to itself. After all, what good is a limitless encyclopedia that supports an online space where users are abusive to each other?".
Randomran felt these were " strong recommendations [with] the potential to work". But he warned that it would be harder in practice than theory:
- "[Y]ou have to keep in mind, they usually have 3 or 4 members who do the dirty work, and 15 members who have solid reputations to back them up. They're only human. Sometimes we forgive someone who fights hard for something we believe in, and get angry at someone who politely pushes for something we are against. So the problem isn't that 20 people are all disruptive, but that 3 disruptive people can be forgiven because there are enough good people who kind of appreciate what they're doing."
Philippe noted the Community Health taskforce reached convergent views, a sign (per Bhneihouse) that there was probably validity "brewing".
Woodwalker questioned whether "true believers" (POV warriors) meant the notion of assuming good faith was bankrupt. He concluded it was a vital point, and should be backed up with a more strict principle that such people should be topic banned immediately. They aren't because (he says):
- "POV is more difficult to remove than vandalism. It requires more time to analyse. We're all volunteers, no admin wants to spend time on something that is likely to be unrewarding, unpopular or tiresome.
- We have been talking about having a "senior editor status". I think it would help, if true believers have no access to or will be stripped of this status. It sounds harsh and elitist, but I think in the end better distinction between user types will raise quality."
Bhneihouse agreed, and noted that it was POV warring that was "elitist" here, because such users presume they have better knowledge than anyone else. "Wikipedia [should] start to quickly identify problem users and hold a hard line about acceptable and unacceptable behavior. It is not that not everyone can play, it's that everyone can play as long as they play nicely."
Randomran noted there were practical issues. POV warriors believe they are doing right, and if a POV warrior and another user argue, "who is the true believer? The one who insists that Wikipedia needs to allow original research? Or the one who insists on reverting and removing original research? A really stubborn editor is going to get a really stubborn response... so which stubborn person are you going to ban? I'm being devil's advocate. But I have direct experience with these kinds of editors... you can't underestimate how hard it is find a solution."
Bhneihouse commented (long post) on these various points, noting agreement on most of them, and adding the following:
- Lack of explicit statement of Wikipedia's brand permits POV warriors to assert they are doing right
- Banning users who do not follow rules is fair provided rules are equitable and fairly applied
- "The key here is to keep "testing" policies/rules/procedures against the brand... I believe that Wikipedia has ideas and beliefs that it follows. I want to see... not some hollow rhetoric about how cool it is to build a comprehensive online encyclopedia, but a real, living, breathing brand statement that encompasses all the values that Wikipedia has or should have".
- Meanwhile, let's do some short term work on behavioral problems... by putting in places rules/policies/procedures that are consistent with what the brand SEEMS to be. That way, we attack the problem top down and bottom up. (Bhneihouse states this view is via FT2)
- Behavioral problems
Philippe asked Bhneihouse how she thought such policies might be put in place.
Bhneihouse proposed the following:
- Distill all policies to 6 principles/behaviours that are short, memorable, enforceable and widely publicized (disrespect, unfounded original cites, etc)
- Empower all admins to work on a 3 warning basis (warn, caution, last chance) followed by a block with 2nd chance only if appropriate. Fair even application to all would be critical, no variance or wavering. Those who can't or won't enforce it should not be admins.
- Content is created by discussion page first. Once the basics of the content are covered an actual article can be created, which would ensure that content pages are verifiable and neutral from the start. (As opposed to create the article first then consider if it's good quality and who will fix it after)
- By doing this, everyone learns to collaborate, there are clear rules, a loose "team" and some trust exists, articles get created once there is some proposed content and some basic consensus/review, the teamwork will itself fight POV warring somewhat, there is a shift from just contributing, to teaching/educating/mentoring, making the project more collaborative and less competitive.
- Taskforce focus
Philippe commented that proposals which would be rejected by communities or otherwise impractical would be wasted. There are already thousands of admins and 100k's of users, who use policies they have developed daily. Their independence of policy making was already part of the mores or embedded philosophies of the communities (and hence brand), as was non-editorial policy making by the Board and its staff. These needed to be honoured. If changing that principle was going to be a taskforce recommendation then so be it (and fine), but in any event, any proposed changes to communal policies would need a clear and communally acceptable migration path. It could not start from a purely "zero" basis.
Woodwalker felt that as all major wikis had their own self-developed policies in place (and perhaps different main issues), the 2 - 4 recommendations should be proposals likely to significantly benefit all projects. But they should not be too general either.
Bhneihouse stated (to Philippe) that the direction things needed to go included thorough brainstorming, a "time consuming process". If the end direction was not understood then the value of taskforce members contributing became questionable. There would be many non-actionable ideas before the best ideas emerged, and "It takes guts to stand up and persuade people that what you are suggesting for them is right for them. It also takes grounding in the background tradition or brand". She requested review of the outline she had proposed (previous section) to see if they made sense, seemed reasonable, were worth auctioning, seemed to reflect the brand, and could be developed as a migration path. There were already people who didn't enjoy the current culture or couldn't edit well in it; so it was questionable whether major changes would significantly increase the "issues" in any practical sense:
- "The people who care about what Wikipedia is and what it was meant to be may be smarter than you think when it comes to understanding enforcement of existing policies. The people who will likely rebel the loudest are the people who are vandalizing and spreading non neutral POV.
- It's not like this is a free speech area where rights are respected. They cannot yell about Wikipedia denying them free speech - that is not a right on Wikipedia due to its mandate as an encyclopedia. So are you saying that Wikipedia is worried that people will say "Oh, no, you cannot curb my right to do X?" Wikipedia already does, it's just that nobody enforces it.
- Personally I do not think admins enforcing rules in a volunteer community with a shared purpose when the rules make it easier to do your "job" will create a rebellion. I think, as I said above, that Wikipedians are already rebelling. The Wikipedia brand doesn't say "we won't have any rules." The brand says "we will be the best, most comprehensive online encyclopedia"."
She felt more time was needed. "It took Wikipedia how long to get into this mess? Can't we have a little more time to figure out how to get Wikipedia out of it?"
Philippe noted that funding and deadlines were budget driven, and due to these financial constraints the original hard limit on timing (mid-January) existed for recommendations.
- Wikipedia has a strong anti-authoritarian community component
Randomran states to Bhneihouse:
- "I'm actually really sympathetic to your vision. But as someone who has tried to fix policy and fix the culture, I think you have to recognize just how hostile that Wikipedia has been towards authority, and it's a more than a significant minority. There are already numerous people who feel that we shouldn't have administrators, let alone arbcom... or at least that we shouldn't entrust them with very much power.
- Arbcom is absolutely terrified of tackling any content or policy issue, aside from enforcing the behavioral norms that already exist. And they're elected by the Wikipedians! Can you imagine their reaction if a few random Wikipedians on an unelected task force got to change the rules to whatever they thought would work? ... For better or for worse, it's a non-starter. (And I honestly believe it's for the worse.)
- So knowing that the trustees are not going to make Wikipedia a markedly more authoritarian place... what can we get the trustees to do? Maybe empower some administrators? Create some processes that will let the community settle issues more effectively, so that true believers will have a harder time obstructing the process? Change the organizational structure a little? We have to take a surgical approach. Can we achieve a big impact with something small and strategic?"
Philippe concurred. The suggestions were close to administrators current work already. He suggested he could walk other taskforce members around a typical administrators workload so they could see for themselves what was done and what issues were coming up, to allow a shared understanding of the role: "I'm not 100% sure that you're operating off a totally informed viewpoint about what administrators do, because I'm not sure you've walked the mile in their shoes"
- Bhneihouse's post before leaving
Bhneihouse wrote a post expressing her frustrations and views on the overall strategy process,in which she stated she was done and could be blocked or banned if needed. (link):
- No comprehensive induction material/URLs, poor collaborative tools, poor management, disconnect in relation to timeline, seeking hard recommendations shortly after commencement, "people who know how to nurture" and to "provide everything we need" missing, team demands to work in a hurry dictated by budgetary requirements.
- Wikimedia is adrift, needing people willing to make tough decisions to ensure the idea stays workable, and admission of mistakes by existing participants where required.
- "If Wikipedia really wants to be the best online encyclopedia it may just have to suck it up and admit that it needs rules and regulations and policies and procedures to ensure a liveable workspace.... [Y]ou go anywhere else offline and psychologists and psychiatrists will tell you that people need boundaries... veritable "home rule" at Wikipedia is [not] consistent with its brand or its mission".
- Proposal - WMF should work with a brand consultancy agency to "assess, qualify and state its brand" (noting this may take time as there are "millions of stakeholders"), then create strategy and engage change consultants to implement the brand across its projects.
- The needed work cannot be done in 60 days, especially with a newly formed team figuring out the basics.
Randomran agreed the process could be frustrating at times but that "we have to do the best that we can". Wikipedia had become to tolerant of problems and was hindered by poor boundary setting, but excessive new boundaries were not perhaps the answer. He gave this example:
- "If you want to program a flock of mechanical birds to fly in a realistic way, it's tempting to get really complicated. Birds must follow a leader. To avoid everyone crashing, you create a hierarchy. Bird one takes the lead, bird two and three follow close behind, until you create a flying V. They must follow the trajectory. They're not allowed to stray too far. To create realism, randomize the velocities and distances within a tight range. Randomly swap their places on occasion.
- But one thing computer scientists figured out was that you could actually achieve flocking behavior with a few simple rules: steer towards the average heading of your neighbors, and avoid crowding. Somehow, these two rules manage to create a very realistic flock of birds.
- I think the lesson is that yes, task forces will need to produce new rules. But can we find just a few rules that have a huge impact?"
He concluded that " we can empower the community to solve its own problems" (a "surgical approach"):
- "Something has gone wrong with our community's processes. Maybe the processes didn't scale very well to the explosion in volunteers, or maybe people have found new ways to abuse those processes. But either way, the processes broke down, and the community could no longer adapt to new problems. I think the most effective thing we can do is fix the processes so that the community can adapt once again. We don't need to direct the community's evolution. We simply need to remove the obstacles that are preventing the community from evolving on its own".
Bhneihouse commented:
- "Then you are saying that the brand of Wikipedia is: "the largest most comprehensive online encyclopedia built by a self governing, self correcting community"
- Up to now, Wikipedia has said: "the largest most comprehensive online encyclopedia" and mention of the community has been omitted. Do you see how knowing your brand drives your actions?
- I care about doing it right. And if doing it right is distilling all of this down to the two rules that will get the flock to "fly right" then I believe that the task forces should have the time to figure those two rules out. I also believe that if, across task forces, we are all coming up with that the solution to quality content is that everyone needs to "fly right" that it is foolish to continue to focus on "quality content" as a subset and force the "answers" down that path. Instead, the different groups should shift their focus to figuring out the two rules to get the community to "fly right"."
Randomran asked reflectively, how you get a "giant" to move: "Very slowly, and only if you can trick them into believing that's where they were already planning on going".
Bhneihouse responded "[If I can take] five months to do actual research (original and secondary) prior to making recommendations of how to and why to move a giant of about 50,000 people, then why wouldn't Wikipedia give more than two months to move its giant of millions of people?"
- Disruptive users again
Randomran noted that we would want to spend time on research, but that in practical terms, "under the circumstances, we can only do our best". He notes two key problems:
- A lot of issues are grey. Example: - "Disruptive [users] can survive on Wikilawyering and the support of a good cabal. Someone relies heavily on a company's press releases to write an article that promotes their product. Someone tries to delete it as original research, and as an advert. They respond that "the information is verified, and it's written in a neutral tone instead of an advert." All hell breaks loose over an issue like that. Have they crossed the line?"
- Policies are descriptive not prescriptive. They can be rewritten by anyone who can obtain consensus; they aren't written in stone or entrenched by Wikipedia's founders. So there is a difficult and very uncertain line between a user being "opinionated" and "disruptive", which is not conducive to deciding when to take administrator action. "Is it fair to exclude someone because they disagree with a policy the way that it is now? What if they fight that policy tooth and nail, and swear up and down that we should "ignore all rules" because they truly believe they are enhancing the encyclopedia? Are they being disruptive?..."
Woodwalker feels this is always evident in behaviour. "when discussions follow the form of intelligent inquiry, consensus will eventually always shift towards higher quality (more neutral, more balanced). It's the contributors that prevent intelligent inquiry (by being rude, by editing against the consensus, etc) that form the real barrier. I am opinionated in many subjects, so are all of us. Yet I keep that in mind when I edit, or simply don't edit the subjects I think I'm not neutral in".
Randomran felt the grey area was a major factor. For example, "a new user who thought something was wrong or untrue on-wiki and said "stop pushing lies" or "I'm an expert, you need to step aside and listen to me" - would that be that offensive? What if a user is one of many people who support a given stance, so that when an admin says a point is "original research" or otherwise insufficient quality he is overwhelmed by furious users?" He commented that at present, anything but obvious stuff is very difficult to address because of these types of issues. In such cases there are often many users who will claim it's right, or "fair game".
Philippe concurred.
Woodwalker felt that Bhneihouse's "brand" was the similar to his term "factors of quality". He felt that "Edits that kill neutrality and/or balance are by far worse [than vandalism, which we block for anyway], because they are so difficult to recognize. We should be prepared to be at least as punitive in such cases. That said, I'm always in favour of second chances, and third, as long as the user shows to have gained insight in why his behaviour was wrong". Bhneihouse concurred.
- End note - communication
MissionInn.Jim pointed to the Wikipedia article on "communication" and specifically to the research showing that some 93% of communication was non-verbal, which "partly explains why there is so much discord on Wikipedia": "People read too much or too little into what is being said, or they just don't grasp intended subtleties because the reader applies their own emphasis on words and interpretation based on their own state of mind. The writer's vocal and physical cues are cut out of the conversation. Misinterpretation quickly escalates into arguments and negative behavior. I find it is critical that I divorce myself from all emotion whenever I write or read something on Wikipedia...."
Woodwalker concurred, noting when Wikipedia stops being "a nice hobby" people leave or take a break. "if we really want to be able to raise quality to a higher level than the ruder part of our contributors is able to understand, we have to somehow get over the barrier of discussions being decided by ignorance and self-over-estimation".
I had suggested earlier we stop working at such a micro level and instead work at a larger macro level. No one took my bait so I decided to draft what I consider barriers to quality as Wikipedia currently functions. This list is from a negative, critical viewpoint that is not obviously capturing everything, neither is it focusing on the positives of some aspects.
I am hoping that others can flesh this out -- in fact, I would like it to be a wiki that everyone can contribute to, in an addition type of format, rather than in an overwrite fashion, but I do not know how to do that on LT, and I do not know how to lock what is already written but allow additions on a wiki. (Pardon my inexperience.) So I am putting it here, in hopes to focus our efforts to a more macro level that all the micro discussions can fit into.
It is just a beginning.
and Kudos to MissionInn.Jim's QualityTF1. I feel that the following information can easily work in his framework.
@MissionInn.Jim: can you organize your QualityTF1 more like an outline?
Barriers to Quality at Wikipedia
Summary
[edit]- Narrow demographics of communities probably leads to an imbalance in project coverage (with respect to the information demand as well as overall quality content) ([1]; [2])
- Quality users become disappointed and leave the projects.
- Rude behaviour leads to quality users leaving the project ([3], # 1.1, 1.2, 1.7 & 1.10)
- Technical, "political" and informational elitism may have a discouraging effect on less active or technically adept users ([4], # 1.3). Part of this barrier are the models of policy-driven policy and content (see here) and maintenance-driven policy and content (see here).
- Status of the user is defined by quantity, not quality of contributions ([5], # 1.4, 1.5 & 1.6).
- Quantity and speed of talk contributions rule discussions, at the cost of the quality of arguments made. ([6], 1.8)
- Tool set of WikiMedia software is limited and user-unfriendly, it discourages new users ([7]).
- Problem of "wiki-erosion": quality of content will erode to a level related to community size ([8]).
Narrow Population/Demographics
[edit]- Mostly male
- Men have a different working style in general
- Men frequently work non collaboratively or in parallel
- Men tend to be less community based than women
- Men’s goals are frequently different
- Men have a different working style in general
- Mostly 20-35
- How do they identify themselves?
- Technically astute?
- Not knowledgeable to contribute in a meaningful way?
- Where are they in their lives?
- Job hunting?
- In their first or second position?
- Single/married/children?
- Their personal goals are not necessarily community oriented
- They do not necessarily have the maturity necessarily to successfully collaborate
- How do they identify themselves?
- Mostly tech-heads
- Profile includes individualistic behavior not conducive to collaboration
- Profile includes a certain amount of possessiveness over knowledge
- Profile includes picking contributions apart rather than external vetting of proffered information leading to attrition of contributors who have different working styles
- Very few women
- Mature female users have more barriers to contribution
- Will tend to have a job and a family, as well as other responsibilities including extended family and community
- Will tend to have a higher stress load than men, even when given the same workloads, i.e. job and family
- Will tend to be the caregivers for extended family, i.e. older parents, aunts/uncles vs. male involvement in caretaking, even when male caretakers are available
- May have less tolerance for a process in which their work is gutted, because of time constraints and other pressing responsibilities perceived as more important that a contribution that may not exist soon after it is created
- Younger female users may also have barriers to contribution
- How do younger female users “see” Wikipedia
- What are the demographics of young female users/potential users and what is the likelihood they are using Wikipedia based on education, marriage at a young age, children at a young age
- How do younger female users identify themselves
- What is their focus in life
- i.e. contributing to a greater good
- getting on with getting their degree
- In the case of younger users who are not academic track, what are their responsibilities in life that may keep them from using/contributing to Wikipedia?
- Is Wikipedia likely to attract young female users who have already married/started a family?
- What sort of time constraints are younger females under that would restrict their participation in Wikipedia?
- What is their focus in life
- Older females
- May have more time to contribute because children are grown and most have lost their parents or other relatives that they may have taken care of
- Immense knowledge base to draw from
- Academic subject matter experts
- Professional subject matter experts
- Personal subject matter experts, i.e. cooking, recipes, teaching younger people how to budget or manage finances
- Technology barriers likely more pervasive in this group
- Because of women’s collaborative skills and community/caring/nurturing orientation, it is likely that Wikipedia would not only benefit from their contribution, but should actively pursue involving more women
- Women tend to be community based
- Women tend to more easily work collaboratively
- Women tend to be less worried about “ownership”
- Mature female users have more barriers to contribution
- Young people
- How many under 18’s are involved?
- What is their barrier to contribution?
- What is Wikipedia actively doing to bring them in and get them to participate?
- Disabled population
- What barriers do they encounter?
- Mental illness/Brain chemistry disorder
- Processing
- Linear
- Argumentative tone may limit participation
- Contribution task a long process, i.e. someone with depression may have difficulty sustained a prolonged task, what can we do to engage them anyway and get them to contribute?
- Mobility
- Typing ability
- Ability to spend a lot of hours in front of a computer
- Sight
- What will a reader such as JAWS do with pages as currently set up on Wikipedia?
- How can we improve layouts or host alternative pages and keep them updated so sight impaired users/contributors have minimal barriers?
- Are we doing this work already?
- Hearing
- If there is an audio clip on any of the Wiki’s are we providing a transcript for hearing impaired users?
- Mental illness/Brain chemistry disorder
- What are we currently doing to engage this population?
- What can we do to remove existing barriers and encourage their participation?
- As a good community citizen, what responsibility does Wikipedia have to reach out to this community?
- What barriers do they encounter?
Wikipedia Culture
[edit]- Positive Observations
- Everyone is welcome
- Anyone can start anywhere to use or contribute to Wikipedia
- You don't have to be an expert to contribute, you can, and are encouraged to, gather work to illustrate your points
- Wikipedia can become a way to learn how to properly do research because it's demands for citations reminds contributors that information must have a solid basis
- Personal opinion discouraged/banned -- as a substitution for fact
- Hard work encouraged
- Ability to only minimally participate welcomed
- No entry is sacred or fixed
- Everyone with online access can benefit from Wikipedia
- Wikipedia seeks to “do good”
- Negative Observations
- Everyone is welcome, no matter how they behave
- Blocked users can return if they apologize
- Some blocked users learn to be good, but others just get better at gaming the system and wikilawyering
- Entire entries can get wiped out – it is as if someone’s work does not matter/never existed
- When entries inappropriately wiped out, time consuming for contributor/editor to restore the information
- Technical and informational elitism
- Interface and tool set allow/can encourage people who are more technically astute to control Wikipedia
- Being technical and logical trumps anything else
- The more you can pick apart an argument/knowledge, the smarter you must be
- Focus on value of contribution vs. just being a part of the community by using Wikipedia
- If you do not contribute you are somehow not part of the community
- Award system
- You have to have stars/awards/recommendations to “move up” in the chain of responsibility
- Much recognition is awarded without consensus or objectivity, making it hard to judge merit
- Some Disruptive Behaviors Are Allowed or Difficult to Eradicate
- Infighting
- Flaming (not allowed but still happens and is not necessarily cause for ban)
- Vandalism
- Reactionary responses sometimes based on incomplete reading of a post or incomplete knowledge of a subject.
- Even if the disruptive editor is sanctioned, the damage that they have done is not repaired
- Civility becomes a defense against all kinds of disruptive behavior
- Civil, but stubborn and uncooperative in discussions
- Civil, but pushes a point of view long after it has been discredited
- Civil, but frequently makes untruthful statements, intentionally or recklessly
- Civil, but constantly pushes Wikipedia to become something that it is not
- Civil, but tries to control an article or discussion by exhausting other editors
- Civil, but travels with a pack of likeminded editors who can overpower an article or discussion
- Picking apart knowledge without going outside the current discussion to independently vet
- Forcing contributors to defend knowledge, similar to academic defense of a thesis
- Current mindset may not be conducive to what Wikipedia portrays as its brand
- Everyone is welcome, no matter how they behave
Limited tool set
[edit]- Tool set inadequate for the job
- Clunky
- Linear
- Must understand coding to use it
- Not user friendly
- Newbies have difficulty with it
- Tool set gets in the way of contribution
- Tool set limited
- Media linked across projects
- Abnormal constraints for a web based encyclopedia
- Cannot replicate other websites due to limited tool set
- All Communication must be in writing
- Written communication is slow and cumbersome
- Written communication does not allow for facial expression and gestures
- Written communication does not allow for vocal and tonal variation
- Written communication does at least force it to be documented
Information base
[edit]- Not well rounded overall
- More even coverage in some languages than others
- What languages have the biggest deficits?
- Should all languages have the same kind of coverage?
- Should coverage be skewed to the amount of the world population speaking/using that language?
- How to determine what needs to be focused on for coverage?
- Big gaps in coverage
- What are these gaps?
- What subjects need to be covered?
- How does Wikipedia ask its users what else it needs to see on Wikipedia?
- People have ideas that they will not create pages for, that someone else may have expertise to provide content
- How to reach a younger audience and get them to participate in creation/ideas?
Recommendations (with critiques in italics)
[edit]- Wikipedia is at a cross roads
- That is not a recommendation, and "Wikipedia's Brand" has no relation to quality.
- Likely it would if only such a Brand existed.
- Wikipedia needs to decide what its brand is, so the brand can drive behavior
- It needs to decide exactly what it is doing and how it is going to do it
- It needs to take a hard look at how it has been operating and what is not working, consistent with its brand, values, mission and goals
- All policies, rules and procedures need to be consistent with the brand, not as lip service but as something that is lived
- Wikipedia needs to lead by example
- That is not a recommendation, and "Wikipedia's Brand" has no relation to quality.
- if Wikipedia wants to truly be a world encyclopedia it has to start reaching people who are offline
- That recommendation has no relation to content quality.
- Nor does it relate particularly to Wikipedia; its online character dominates its nature.
- That recommendation has no relation to content quality.
- perhaps Wikipedia needs to work at furnishing computers to areas of the world that do not have many, and to poor kids who need access, whatever area of the world they are in
- That recommendation has no relation to content quality.
- Wikipedia needs a more diverse contributor base
That is not a recommendation and there is very limited data supporting the idea that diversity has any relation to content quality beyond content coverage- It is a recommendation, and depending on the direction of expansion of the contributor base it could contribute hugely to quality.
- I agree, and stand corrected. I am copying the recommendation below.
- It is a recommendation, and depending on the direction of expansion of the contributor base it could contribute hugely to quality.
- Wikipedia needs to be more even handed in the information that is covered
- That recommendation is so unclear (what does "even handed" mean?) that it's impossible to say whether it relates to content quality.
- Wikipedia needs to start cultivating a kid audience for contribution
- I agree with this recommendation: I believe we should support beginning editors of all ages
- In many ways, Wikipedia already is an educational project rather than an encyclopedia (and losing the struggle to educate). I do not see any benefit in bringing kids into an environment where they will be shot at, or where they will form child packs doing the shooting.
- This brings them in earlier
- It teaches them how to use and contribute
- They have an immense ability to learn the curve of participation, help contribute for households and bring in an older audience by showing them how to participate or helping them participate
- Kids need knowledge, it’s the only thing that elevates their life and their purpose in life
- By collaborating early in a safe environment with the right rules and policies, Wikipedia is in a position to teach kids skills they need in their entire life, not just online at Wikipedia
- I agree with this recommendation: I believe we should support beginning editors of all ages
- Wikipedia needs to show by example
- I agree with this recommendation, but it is too vague for me to be able to endorse it. We need specific Foundation and project policy changes to support continued increases in quality.
- It needs to be the gold standard of collaboration
- Rules and policies need to be forged that make it not only a safe place to collaborate but also teaches people how to collaborate, and improves overall culture not only with knowledge but with skills
Another attempt at breaching barriers to quality
[edit]- Wikimedia projects need to support beginning editors of all ages;
- Perhaps, but what does it have to with quality and especially barriers to quality?
- That proposal is carried forward from the ideas above. This will cover inclusion of new users, our only renewable source of editorial talent, inclusion of beginning English language users, and the developmentally disabled. These proposals are intended to breach the barriers to quality.
- Perhaps, but what does it have to with quality and especially barriers to quality?
- Wikimedia projects need to treat their top-line volunteers at least as well as established educational, communications, and other respected nonprofit organizations treat their most important volunteers;
- This is hopelessly vague. What "established educational, communications, and other respected nonprofit organizations": there are myriads of them. And in what respect?
- That is currently under Quality Task Force discussion. Cash may have advantages over community recognition, especially for volunteers who want to stay anonymous, perhaps because they were threatened or do not want their employer to know that they edit
- This is hopelessly vague. What "established educational, communications, and other respected nonprofit organizations": there are myriads of them. And in what respect?
- Wikimedia projects need to take concrete steps to ensure that they do not contradict established policies; for example:
- Very vague: what established policies?
- As below, avoiding these barriers to quality:
- Implying that the elimination of anonymity could improve content quality; or
- Nobody real is implying that? Looks like a side issue.
- It has been implied, repeatedly. It is one of the issues recognized as "Foundation" and "perennial."
- Nobody real is implying that? Looks like a side issue.
- Allowing obvious exceptions to established policies to stand.
- Vague. (BTW: I do not expect to live to see the day when the English Wikipedia will start to enforce NOR, NPoV and V)
- We've already seen the start; I'm sure we'll not see the finish.
- Vague. (BTW: I do not expect to live to see the day when the English Wikipedia will start to enforce NOR, NPoV and V)
- Very vague: what established policies?
- Wikimedia projects should use flagged revisions for biographies of living people
- That would be Wikipedia projects?
- On the contrary, I believe the encyclopedia would be best served if all Wikimedia projects adopted that policy.
- That would be Wikipedia projects?
- Wikipedia needs a more diverse contributor base, and can achieve that by implementing outreach proposals, e.g.:
Note: I have moved this outline to Task force/Wikipedia Quality/Barriers to quality [link updated - FT2]. Please make additions/change suggestions there. - Philippe
Bhneihouse, this is really good :-) I'd like to add/elaborate/refine, but I'm not sure A) if you want people to edit this, and if you do B) how to do it in LT.
More broadly, I have noticed we all seem to be using LT for everything -- discussions, but also "documents." I wonder if that's deliberate: I think non-LT wiki pages might be better suited to some kinds of work.
FYI, you edit a post in LQT by hitting the "more" drop down arrow (next to reply) and selecting "Edit". It then changes the post status to "Edited by other users" and your edits are recorded in the post history.
You're welcome to use new pages to edit documents, that don't have to be LQT based - we'd ask you to be sure they're linked from the task force page or a LQT discussion page so that it's transparent work. :)
Sue, yes, I would very much like edits, but if you would, I would like them, per my paragraph at the beginning of the post, to be in an ADDITIVE fashion vs. an overwrite fashion, as would be the norm for a wiki page. If you disagree with something, perhaps you could follow an outline format and add the information with a question mark after it so we know that it is a question or questioning a statement.
Also, per my "Beginnings" thread, I would very much like a Wiki for this process, but again in an additive fashion, because I think we need a framework/outline to fill in.
What I am looking for is a place to cull ALL ideas about a topic, whether they are all vetted/not vetted, and then have the bunch of us discuss them. If anyone has cites or wants to cite anything I have written, please feel free. If not, that is also fine. I dont have time to do this and I think much of what I wrote is common knowledge to a large esxtent. (A question: how seriously do we take information we know to be true but that isnt cited? that is also a question for Wikipedia in general.)
If someone wants to make this a wiki, feel free, as long as it is clear up front that it is ADDITIVE. I just dont have time to learn how to create a wiki right now.
I am glad you like it Sue. It was one of those "I went to sleep frustrated with this and woke up knowing I had to write a document" sort of moments.
Good work, keep going! This actually helps to share your outlook a lot more than descriptive words.
I have a major observation here: quality "forks" multiple ways (it's a big topic!). The forks overlap and are part of a whole, but are best examined as separate issues in their own right. We need separate dialogs for the following, because "quality" is too broad a word in retrospect.
If we were redoing this, I would suggest 2-3 more specific quality taskforces, focusing upon:
- External (reader/user) quality -- quality of our public face. Includes both quality of content (our wikis) and quality of contact (the ability to reach all, communicate with all, involve all). The quality of our offering.
- Internal (editorial) quality -- the way our editorial related processes work, how we invite new people to edit, who should/should not edit, content and sources, disputes, breadth of knowledge and coverage in the wikis, breadth of experience and interests in the editorial community, skill development and sharing to keep interest high, helping good content to stay, and the like.
- Perception of quality -- what matters to the perception of quality, in the minds of third parties, readers, and editors, and in the media that they glean impressions from.
- (And perhaps, quality as a guiding concept -- what matters in terms of "quality" for us, and which groups are looking at these.)
Originally, I thought (and still suspect) "quality" for this purpose designates 1/ the quality of our written content and 2/ the processes needed to create quality content. If it's going to include a very wide sense of the term, then it's subsuming all other taskforces and we have no chance of anything useful in the time allotted. We may need to assume that other teams will look at other aspects, and focus on a more narrow and "everyday" sense of the term. Just saying' !
FT2, and all:
I like the idea of addressing quality as subcategories however, I think they all still belong here as they are, as you suggested intertwined (overlapping in your parlance.) Also, this is a Quality taskforce. No one said to us: just look at quality of content. I never saw it as such, although some of us may have. If we dont address quality on a basic structural level then its like building a beautiful house on a shaky foundation -- it won't last.
Yes, it is a very big task for the time allotted, which is why I keep trying to focus everyone to the bigger picture, which is where I think that quality comes from. If we refocus to the big picture, then we have a set of benchmarks to assess all suggestions, policies, rules, etc. against. (that benchmark is the "brand" work but I did not say the word "brand" here...mumble mumble mumble.)
In a way this asks the question: What should we be addressing as the Quality Taks Force? Should we be addressing minute details of how admins do their jobs or should we be addressing the larger quality issues and making recommendations that will later lead to addressing the minute details.
I go for door number two. Can we vote or try to come to some consensus on what we are doing? perhaps a supermajority?
I want to address what is standing in they way of making Wikipedia what it wants to be because that is the ultimate quality issue. (Of course that assumes we know what Wikipedia wants to be. mumble brand mumble.) (mumble see Beginning thread for outline/framework mumble mumble brand mumble.) Then I would like for us to craft a set of recommendations and continue the process after the recommendations are "shared," of crafting specific "fixes" for problem areas, for example: identifying what teenage girls want on Wikipedia, what kind of tools they might want/need to utilize and crafting a Wikipedia in the Schools program to expose kids to engaging in learning on Wikipedia.
All of this is going to drive new inroads into the minute details. For example: while rules and policies need to be consistent, there may be a different mentoring/rule approach to teen centered content or teen users/contributors. They may get a bit more oversight until they get the heng of how they should appropriately contribute. For self identified technophobes, we may have a mentoring/wizard approach that allows them to do very little other than type and choose something graphically, and those people may need editors who look at the content/wikis for different things such as obvious newbie non tech types of mistakes. Do you see how defining who and what you are, and what your purpose is drives actions? And it is those actions that create or negate quality on Wikipedia.
And, a last point, I cannot and will not assume that other task forces are handling big picture in their work. I don't have time to comb their LT and I feel that overall quality belongs here.
Yes, I admit it, I am a structure girl.
If there is that big an uncertainty on the remit, we urgently need to pull in those who set up the taskforce and discuss, not assume. At the least we need to note the prospective scope and ask if they had understood we might look that widely before doing so.
And if we do look that widely, we still need to specifically look at quality of content. I would feel very disturbed to discover our recommendations were high level and not directly targeting content matters, all other taskforces looked at their areas, and therefore the collective conclusion of us all, included no actual actionable specific views on content quality as a result despite that being perhaps one of the main desirables of the whole process.
Brenda here on Blackberry.
Tentatively yes and yes. I agree that it may be time to go back to the task force group for clarification. And if the job isn't "ours" I will ask that this job be given to an existing taskforce. More when on a computer.
And FT2 I decidely don't want to disturb you mumble brand mumble. ;)
On your post: we're apparently considering _three_ doors here, but one seems to be agreed not helpful. Door #1 is very low level (how admins should act, etc), #2 is quality of content (and what approaches will have most substantive impact on it, and on the community's ability to create and sustain it), #3 is quality of project (ie what is Wikipedia's core and what does that drive elsewhere). I think we agree #1 isn't a suitable level, but we probably all agree that 2 and 3 are each valid and very useful.
So, a further possible thought: - I notice that new taskforces are easy to set up. Perhaps one option when seeking clarification, would be to spawn a specific sub-task, purely for quality of content. Same team, same membership, same users still contributing to both, but the approaches, focus, and such are very distinct.
Gut instinct. If we do have to consider broad quality remit (which I'm not averse to at all provided we don't overlook content quality by doing so)... then I think we will have so much to do that the big stuff for each is best worked out in its own "space". Their focus is very different (in scale and perspective). And both sets of conclusions will independently be very valuable.
should it be me getting clarification?
Admins, content, big picture -- I dont see them as three doors, I see door number one as the micro level including admins and content and I see door number two as the macro or big picture.
I reread our mandate from the quality task force Wiki twice today. There was a large blanket statement about quality, not specific just to content. I still think we need to have a "talk" with those holding the strategy cards about what the concept of Wikipedia Quality covers to them, and then pitch a case for a wholesale look at the big picture if we feel it is necessary (obviously yes in my book.)
And, I never assumed quality of content would be subsumed by anything. If the quality of content is not there, then my mandate to myself to help Wikipedia be cite-able by college students will never come to fruition. :)
@FT2:
Please do not let me forget your first few points in this post -- discuss and not assume; clarify the prospective scope with people before involving them; keep focusing on content; look cross task force to see if others are doing similar high level work.
- ) thanks.
Just want to say this is fantastic. Keep working on this list. I always find that I come up with better solutions when I have a complete picture of the problem.
Bhneihouse: Great job outlining the Barriers.
I placed the outline at Task force/Wikipedia Quality/Action Plan. If has anything to add, please feel free to do so. I wasn't sure what to name it or where to place it. I don't mind if anyone feels it should be renamed or relocated.
I might try my hand at something similar on content quality, with a view to seeing if it can inform or integrate into it. I hope it compliments, rather than tangents, that approach -- quality is a big word! :)
MissionInn.Jim, perhaps a link to the Wiki Eugene/Philippe set up rather than including the text wholesale on your wiki? this way, edit once, everything updates.
FT2, good idea about content quality! perhaps a what is working, what isnt working, recommendations, summations/inclusion of ideas from this dialogue? a similar format may help to keep it readable for people coming in new to this.
I think the content quality wiki should be linked somehow to the Barriers Wiki so it shows we are addressing the content issues, i.e. breath of content, etc.
Could someone work on something akin to a "culture" wiki that might start to cull the comments on this discussion regarding admins, rating contributors/editors, etc.? that will show we are addressing issues regarding making the culture more amenable to new users and offsetting deficits in the culture as exists. Any takers?
Eventually I see all these different wikis linked together and underpinning our recommendations as a group re: Quality.
Started Task force/Wikipedia Quality/Content quality. Will review this page and summarize the issues there to resume from where it got up to.
Part of the reason I put it in its own wiki page is because people can work on it independently of the barriers page. I'm OK with combining the two, but then we would need another name for the "Barriers to quality" wiki page. It would no longer be just "Barriers to Quality". Having them separate we can start a discussion about on that page's own discussion page. I am finding that when I call up this discussion page, it can take several minutes and several warning messages to get it displayed. It is very annoying to have to wait so long. Everytime something is added, it seems to take longer.
MissionInn.Jim:
Just link to the Barriers page, you can still continue to work on your threads separately. My concern is that the Barriers information will be posted in several different places with the challenge of revision control.
Oh and I forgot, I am having the same problem with the page loading and had to turn off checking scripts on this page for it to open on its own without my intervention.
Anyone know why this slow down with LT may be happening when it handles more information?
The magic of transclusion can help with that... instead of reposting the info, just use {{:Barriers to quality}} and then it's actually displaying the info from the original page. :)
Bhneihouse: this is a good list. Some things I agree with wholeheartedly, others are less realistic/important imho. We do have to find ways to get this more practically applicable though, and for that we need better analysis of many things. For now I'll just comment on your recommendations:
- (Wikipedia is at a cross roads): That's why we're here. I agree.
- (if Wikipedia wants to truly be a world encyclopedia it has to start reaching people who are offline): I agree that Wikipedia has a certain average contributor profile and that it would be good to have other groups represented more equally. For that we need a better PR! More social communication, try to reach beyond the PC screen - send promotors to schools, homes for the elderly, etc. But how, if the average contributor is a technically adept, socially narrow-focussed male? The foundation and chapters should take the lead imho. New technically digibetic users could get more personal supervision too.
- (perhaps Wikipedia needs to work at furnishing computers to areas of the world that do not have many): nice ideal, but is it practically possible to make a serious impact in say, ten years?
- (Wikipedia needs a more diverse contributor base) as per #2
- (Wikipedia needs to be more even handed in the information that is covered) We're back at the idea of the 1000 topic lists? I'm all in favour of that. Some information is universal and universally important to include, even if it doesn't attract the flocks of readers like Harry Potter or Rihanna.
- (Wikipedia needs to start cultivating a kid audience for contribution) That's simply a great idea. See also per #2 -> PR at schools.
- (Wikipedia needs to show by example) -> Yes, people should start to read guidelines and each others talk contributions instead of reacting on one mere word. Discussions turn sour because people don't take the time to read well and understand each other's position.
This needs more serious thought than I can give it right now but in principle I seems to agree with most of it.
NOTE: can someone set up the Barriers wiki so that only additive content is allowed? I dont want to go to history to see what is changed, and I dont want overwrites. I know this is a new way of working but it is similar to what we are doing here on LT but without the overwrites so people can see what is said, what is agreed with and what is disagreed with.
also, the one subhead "Wikipedia Culture" needs to be put back in place and a sub sub heading of "Some Disruptive Behaviors Are Allowed" needs to be put in place. THINK OUTLINE. Dont even think Wiki, just think DISCUSSION OUTLINE that happens to be a Wiki.
Other than seeing what we as a group, everyone represented think, this is a pilot for a concept that FT2 proposed off-LT and that I am trying to create and have us refine to see if it works prior to making it a recommendation.
- )
No, there's not a way to set it up so that only additive content is allowed. Wikis are about allowing people to edit and not restricting editing. They're about the community as a whole writing a better article than one person. :)
Philippe
I do understand how wiki's work. I am trying to understand if Wiki's can be used as additive discussion boards where the information is better organized and easier to load, i.e. less computer resource intensive, and thus perhaps more productive that the LT type of forum.
It has been tossed around that content may need to be locked at some point after it is authored and edited. That led me to believe that a strategic planning wiki may have the capability of being partially locked and being edited.
The point of the type of wiki I am talking about IS about MANY people contributing. I think you are not understanding what I have been proposing. If someone can contribute, like on LT, but the content is then uneditable, the wiki/LT becomes a cummulative "idea sheet" rather than a place where someone posts an idea and it might disappear or become changed because someone did not agree, did not like it or wanted to refine it. to How about, instead of editing capabilities on a strategy wiki, people could comment on that in an outline level on a wiki? that would take away the ponderous nature of LT that many of us are not liking and would allow us to better organize and more easily organize our thoughts. It would also leave a "trail" that was not in history, making it easier for non-wiki-warriors to see all the information without reading through code.
I am TRYING to put in place some procedures right here and now to test their usability prior to making recommendations of new ways to work to improve quality on Wikipedia. It seems to me that this would be a really good place to try some things out. I would really like to start seeing people thinking outside the box, as cliche as that is, to put themselves in other peoples' shoes to get a better understanding of what the non-wiki-warrior experience is like and how we might improve the experience to attract and retain those Wikipedia NEEDS to progress.
I am identifying a problem I keep running into. Wikipedia wants contributions, it wants strategic reocmmendations, it wants us to work to make things better. But it seems that every time I propose something that isnt currently part of the Wikipedia culture or might be an experiment someone pushes back at me and says "no, that isnt the way we do it here." Well if what Wikipedia DID HERE was so successful then we wouldnt be having these strategic task forces. So how about someone says YES to me once in a while instead of NO. I am very tired of hearing NO. I am just like all of the other new users who get "pissed off" on Wikipedia. After a while of hearing NO I will start to think that my contributions have no value, that the system really isnt interested in change and that Wikipedia is just a bunch of young single guys with nothing better to do that to write content for an encyclopedia whose approach and interface is already outdated. The fact that I have to get outraged is not a good sign. Outrage is NOT my M.O. it is what i USE to push appropriate change.
If I am going to get outraged, I can meet with Mayor Heidi Davidson about not enough handicapped parking spaces in Athens and my time might be better spent.
Please do nor write me any placating emails or posts. DO SOMETHING ABOUT the fact that it seems all I am hearing is NO's.
And by the way, I still assert that you do not give an otherwise untested technology, i.e. LT, which is time consuming, clunky and inappropriate, to a strategic group charged with fixing things. I don't think it is an issue of "eating our own dog food." I think it is an issue of if you want a quarterback to do a good job, you give him good shoes and good gloves. It just took 30 seconds for LT to give me a page preview.
btw, I just waited another forty seconds for the page to save and refresh from adding the prior post. I am on a Dell Mini 10 which is my road warrior take anywhere laptop, lightweight, incredible battery life. This is the future. Smaller, less powerful computers, rather than larger more powerful computers. How can/does Wikipedia satisfy the Quality needs of users who are not using dual or quad processor systems with a ton of RAM? Why should I have to wait almost a minute for a page refresh on a project where I am contributing as a volunteer? What incentive to do I have to continue to work when the actual process of contributing is so cumbersome it makes me want to shut my computer and get a cup of coffee?
Someone say YES, that this issue matters, and fix it so we can have a more effective platform to contribute on.
Put on your seatbelts, this is gonna be long...
Woodwalker: “We do have to find ways to get this more practically applicable though, and for that we need better analysis of many things.” Yes, which is why I keep going back to analyzing what currently exists, taking the user experiences we wish people to have at Wikipedia and using them as a litmus test to see if what currently exists fulfills those experiences and if not, what needs to be done to ensure that the Wikipedia experience is appropriate and meaningful in a positive way. '
- “(Wikipedia is at a cross roads)…I agree”' YES!
- “But how (do we change?)The foundation and chapters should take the lead imho. New…users could get more personal supervision too.” Yes and Yes
- “(perhaps Wikipedia needs to work at furnishing computers…): nice ideal, but is it…possible…in say, ten years?” I am not sure but what I do know is that every day hundreds of users at our county library utilize computers in the Gates Computer lab – many of whom would not otherwise have use of a computer. I am pretty good at getting corporations and people to give to those who need, I am certain there are thousands more people like me who have this skill. All we have to do is focus it and we can attain this goal.
- “ (Wikipedia needs to be more even handed in the information that is covered)…I'm all in favour of that...” This is a long term project. There is a lot of information in the world. The Guttenberg project has something similar going on with literature and from seeing their results I know that this is doable. Perhaps we need to section topic areas off and try to fill in a bit of each and then more of each and then…until those topic areas are better populated. I think this is an area worth discussion – how to approach more comprehensive content – as appropriate for a quality team. Breadth of content creates better quality.
- “(Wikipedia needs to start cultivating a kid audience for contribution) That's simply a great idea.” Thanks. I also wish Wikipedia to be host for working groups for school and university kids. Why not a Wikipedia style “wave”? and Wiki groups? (of course once we get more basic issues under better control.)
- “(Wikipedia needs to show by example) -> Yes, people should start to read guidelines and each others talk contributions instead of reacting on one mere word. Discussions turn sour because people don't take the time to read well and understand each other's position.” This is where a 24 hour rule is good. Some of my profs won’t allow us to discuss our grades on a test or a paper for 24 hours so we really think about what it is they have “said” and what we really want to say. This is but one example. People who regularly can be shown to not actually read content yet react to it can eventually get a negative rating score of some sort. (I am certain yall can work this one out – I have seen great discussions of metrics/procedures on here.) Teaching people the power of forgiveness, of flexibility, of all the tools they need to be good collaborators is truly KEY if Wikipedia is going to exist in ten years. This how we become the gold standard – by teaching. If knowledge is power then those who teach are truly great. We teach others what we know about how to work together. We figure it out, we define it, we create wizards, we create videos, we do whatever it is we need to do to ensure that people can learn what it is they need to know to participate. And we remove barriers to participation.
I know this is a really long post, but I want to share something that ties into this post.
I am incredibly late on a paper on civil disobedience for a key class in my major. Today, after class, I showed my professor of Social Justice, Dr. Alexander Kaufman, http://www.uga.edu/pol-sci/people/kaufman.htm, the Barrier Wiki. I told him how angry I got at first at how LT wasn’t working right, how I felt the group wasn’t working in a way that I felt productive, how I had the choice to do “civil disobedience” and walk away to make a point or how I could choose to stay. I told him I was working out the principles in the paper on this Wiki and on this Task Force. I also told him that what he has taught me about Rawls and Social Justice is the foundation for my work on this Task Force – that everyone needs to be included and everyone is worthy of consideration and respect, and that the benefits of natural and social endowments need to positively impact those with the least. And the cool thing is that you guys/gals are responding to what I am sharing that he taught me.
Everything Kaufman teaches me I can share with someone else. Teaching a student may be the single greatest thing that Kaufman can give to all of us, as long as we continue to share that which we learn with others and they share with more people. Teaching, whether it is how to collaborate, or what social justice is, may be the single biggest gift we can give to someone. And this is how knowledge lives on.
And this is why Wikipedia is powerful.
I think it may be possible to challenge the existing community to be teachers. I think there may be a myriad of ways to entice them to play by rules not of their own making to create a just result. We just haven’t explored them all. So while we are adding to the community, we can also heal the community. Each of us has a teacher inside of us. We just have to figure out how to harness all of those Alexander Kaufmans, give them the tools they need and take away the barriers to participation.
Oh and guys/girls, all of this is about Wikipedia’s brand, as I perceive it. mumble brand mumble. (Okay, I give up on trying to get the format of this to be any more readable.)
Thanks, this was like educating me, since I'm only a geologist and know nothing of the sort. I'd like to give two examples from my own experience, that gave me the faith the wiki-concept can work if people are shown the way how to better communicate/contribute. I'm myself not a technical type, besides I don't have experience with internet apart from Wikipedia, the occasional news site and email. Last year I started a facebook profile, only because my wiki friends asked me. So I probably don't fit in the average contributor profile we discussed. I started contributing when a friend took me behind a PC and showed me how Wikipedia works (letter by letter). If that hadn't happened, I would never have edited.
My first example is about content and about the 1000 article list. When I started editing Wikipedia, we had a list of all subjects covered by Encarta at wp-nl. I began by writing one or two articles about geology from red links in the list every day. Without the list, I wouldn't have known where to start. Even if contributors have the knowledge to add content, they often don't know how to start logistically/structurally or even what things are needed because of the information demand of the readers or the coverage of the project. Without the list, I would've lost interest pretty soon, just because I couldn't have come up with all these subjects myself. A month ago I scrolled through the 1000 article list at meta, and I found the geology section pretty bad, even though it contains only about 20-30 subjects. Then it occurred to me I would, with the help of other geologists active on Wikipedias, be well able to make a separate list of 1000 articles about geology alone (100 rock types, 100 minerals, etc - 1000 seems a lot but it is still only enough to include general topics). Besides, we could make a list of articles with other subjects that should have a section on geology as well (for example: the Rocky Mnts, the Atlantic Ocean). Other users with specialist knowledge could make similar lists for their specific areas of expertise. Some knowledge is universal and should be included in all wikipedias. Such lists would be beneficial for small and medium-sized projects, but probably also still for the larger ones. Users will then have a way of knowing where to start adding content, even without needing to have the knowledge themselves (they can translate from larger wikis), instead of getting lost in policies/rules/talk pages, which is so easy on wikis.
Second example is from my experience as an admin/arbcom member. In contrast to most of my colleagues, I'm not often for blocking problematic users, unless there is clearly bad intent. Rather, I'd go for other restrictions or make 'deals' with them ('you do this or else I block you'). For example: don't do more than 5 edits at talk pages every week, don't edit the village pump or election debate pages, etc. The results have been mostly positive. Most of these well-intending problematic users can become good contributors when they just have a little less freedom/choice where and when to edit. The most surprising aspect to me is that many of them were afterwards thankful and told me they'd never have figured out how to get constructive for themselves. I think your ideas of 24 hour reaction time and teaching users how to communicate/contribute are super. Editing Wikipedia shouldn't be a matter of simply signing in and then having total freedom, it should be a learning process that only begins with signing in. I understand this doesn't seem compatible with the liberal ideals and mentality of the founders and many of the current incrowd of Wikipedia, yet I think this is a misconception. I think guiding contributors to more constructive ways is in a way even more compatible with our ideals than the total freedom to behave, edit and do as you like we have now. Yes, why not have anonymous ratings for every talk contribution? That would really force people to become more constructive in discussions and help the consensus building process.
I think all of us agree something has to be done about behaviour. The question is mainly how to convince the communities and how to make a recommendation that will have impact.
Ok I officially hate LT. foty five minutes of typing and organizing lost because I was working on the web page. I have to run to take my daughter to the doctor, but this is a reminder to myself to come back and edit this message to respond to Woodwalker.
Woodwalker, for now my comments are: great post.
Brenda
It would be most helpful if you could document what happened. For instance, what behaviors were experienced? What happened? What did you do immediately prior? Were there error messages?
I had the same experience (lost ~15 minutes of writing) when I wrote my long message above (8:55, 2 December 2009). I was patrolling vandalism at the same time and accidentally clicked and opened a link in the same window. I went back to this page but my text was gone, which normally doesn't happen in Firefox.
Yeah, Andrew told me this morning that he's working on EXACTLY that issue - making sure that the text is buffered or something so that it's there when you hit the "back" button.
same issue. working on a Mini 10 with small keyboard and literally grazed the mouse pad, the page went forward and when I went back I had lost everything. At one point I had copied it to clipboard but I had just copied a URL from another window to share and that knocked my buffer for the clipboard. :( Will rewrite in a bit. Busy day.
@woodwalker, this was good stuff. I have been trying for a few days to respond to this and will when I am caught up.
Good points. I'd suggest adding something to recommendations to deal with "Some Disruptive Behaviors Are Allowed" (in particular, 1,4). You mention: "t needs to be the gold standard of collaboration". Certainly - but with the increasingly more poisonous atmosphere, due to the failure of community to stop flaming/harassment/etc., it is becoming worse and worse...
Piotrus, IMHO, I think that the community itself needs to radically change, it needs to diversify, it needs to feel empowered to police itself and it needs to have policies and guidelines in place that support the community members in acting correctly in the first place and empowers them to police themselves.
That is a HUGE statement, I realize this.
- to radically change, an external body is going to have to engage in behaviors that will encourage new members of target populations, whether it be Wikipedia in the Schools/Universities, Wikipedia in the Workplace, or general PR and Marketing efforts to encourage a wider variety of users. The external body may be a group of Wikipedians or it may be another group. If the group itself will not come in line with Wikipedia’s policies and goals, then some force has to reshape the group.
- to draft those policies, certain things need to be identified that will guide the creation of those policies and rules. Again, that may happen from a small body, an external body or by a general “vote” of some kind. However, it is tricky when the body that is “voting” is the one causing the problems.
- remember this, no matter what the result of the Wikipedia project, it was a small group that originally got it started. If something external needed to rein it in and reshape it in order for it to become what it was originally intended to be, that might not be a bad thing.
What I do know, is that the demographics I see at Wikipedia are a bit like an implosion waiting to happen. If something doesn’t change, Wikipedia has the potential to be the best idea with the worst implementation people ever heard of. Sometimes, we give up some of our “freedoms” i.e. the freedom for every user to have a say in every decision, in order to get what we wanted in the first place.
I fear that many Wikipedians aren’t willing to engage in trade offs.
I, like many of us on this task force, have been a part of many online communities. All of us have seen people with the wrong mindset destroy projects with great potential. We have a choice. We figure out how to fix it and make it better for a lot of other people, in this case, billions of people; or we say it’s too difficult to make it work and we let the jerks take over. Personally as much as I hate conflict and fighting, I’m for proving we can make this work. So, Piotrus, go fill in the Barriers Wiki, add to the lists and let’s see where we get with this.
Am I being too optimistic?
You're imho too pessimistic. I think we don't need to take away freedom to solve the particular problem of rude/non-constructive behaviour. Feedback to every single talk edit can probably solve the thing without having to force people not to participate in every discussion. For example, multiple choice (definitely yes/yes/a little/not at all):
Do you think this contribution:
- Is relevant for the discussed subject?
- Is relevant for the project's goals?
- Is friendly/nice?
- etc
If a small mark shows next to all your talk edits, you will think twice before commenting. I think the whole problem of rude behaviour can be erased without having to forbid participation.
Hi all:
I am in the middle of finals and making up work for being out of school for three weeks earlier this semester due to H1N1 (swine flu.) As such I am behind the eight ball. There are things I see that might benefit the task force to look at and integrate but I have limited time and would like to keep my focus on structural quality issues. Would someone be willing to run with an idea I have? I was wondering if it might be good to go through http://en.wikipedia.org/wiki/Wikipedia:Perennial_proposals#Prohibit_anonymous_users_from_editing to see if there are any past usable suggestions relating to quality both structural and content, and if going through this document might lead us to answer the question "what has been tried in the past and what has worked/failed?"
I apologize because I know we all pull our own load here but I have a sick kid and finals/remediation for the semester and I would hate to not be looking at articles like this and integrating them just because I am short of time. I think articles like this have immense value.
Brenda
Hi, I'm sorry, but at the moment I'm very sad and disappointed in Wikipedia. I was already on a wikibreak at wp-nl because I got irritated by my colleagues. Things I wrote were misinterpreted constantly (or just not read at all - even so they all had an opinion about what I wrote), others were just aggressive and incredibly rude.
Now I got into the same situation at wp-en. I don't mind loosing a discussion, I don't mind if I don't get my way. I can distinguish between important things and minor unimportant problems that aren't worth the fuzz or irritation. But what I can't stand is to be misunderstood because people don't take the time to read what I write; what I can't stand is people being too stupid to understand what a discussion is about yet contributing in those discussions in an often aggressive, personally directed and provocative way. I can't stand to be framed every time, being called names even after leaving a discussion.
At the moment Wikipedia is an irritating experience to me. I think it's the idiots that can't communicate in a constructive way we should worry about, not the IPs. As I said, vandalism is probably not the worst problem for quality, the worst problem is wide-spread ignorance combined with self-over-estimation among the most active users.
Just wanted to show a little solidarity with Woodwalker.
There's too many people on Wikipedia who are more opinionated than smart, and there's too many people who are more self-serving than they are cooperative. And when someone is opinionated AND self-serving? You see the quality of the encyclopedia suffer. And there's no downside to being opinionated and self-serving so long as you can find a few passive aggressive people to support and protect you.
I am so glad both of you shared your experiences. I am not happy you experienced them.
I believe we can change the demographics and this will help to alleviate a part of the issue as people with different ideas, opinions and ways of behaving start to "infiltrate" in a good way.
I also believe that crafting procedures for admins and empowering them to be vocal, to teach, to ban on actionable offenses, etc. will start to change the culture to this behavior is not tolerated.
As we can all see, the culture drives the content. If you aren't happy with how you are treated it's hard to contribute. If people infight, etc. it gets in the way of quality content. If you are so unhappy that you go away, we as a community lose and the content suffers.
There is a possibility for change, don't give up. Our words and our actions matter. We can give up and walk away or we can dig in for the fight for the right -- the right focus for Wikipedia, the right way to do things that take everyone and all the priorities into account, the right to be treated respectfully while we try to help others.
Actually, the admins are doing a good job of warning and sanctioning people on actionable offenses. The problem is the inactionable offenses.
First, passive aggressive behavior is not actionable. "That doesn't even make any sense. Is English your first language?" "You're a liar. You have zero credibility on this discussion." "My point would be clear to anyone who was at least slightly intelligent." "Quit wasting everyone's time." Most of the time, you can shrug those off by saying you weren't attacking anyone, but were trying to state a firm point. Are they really going to ban or block someone for those? No, that's reserved for people who are stupid enough to lash out directly. If you're indirect enough, you get a warning, and then you go back to your business.
Second, large patterns of borderline behavior are impossible to deal with in practice. That's if you can get passed the argument "but I didn't cross the line. I followed every policy to the letter." Then you have to deal with the large counter-pattern of behavior. If you want to look at their 6 month record, they get to use 6 months of virtually any one else's record, and it only takes one troll to make them look good. "See? In February, a troll told me to shut up. Ever since, all I've been doing is standing up for myself." Every big attack gives them license to make dozens of smaller attacks.
Finally, you can get away with more than passive aggressive behavior if you have a team on your side. Imagine that every AN/I incident turns from a 2 person discussion to a 20 versus 20 discussion. And if an administrator jumps in, God help them. There's so much bickering back and forth that it's almost impossible to figure out who is at fault, so usually it ends with "knock it off, both sides", which is completely ineffective. What's worse, no matter what they decide, there will be 20 angry people ready to accuse them of being biased, of misreading the situation, of being incompetent. No wonder we've been hemorrhaging administrators. It's shitty work.
I'm not even sure what the solution is. We could tighten the grip, go beyond the obvious jerks and start targeting the stubborn people, the passive aggressive people, and the self-serving opinionated people. But then I doubt there would be anyone left on Wikipedia. That's the culture we have.
- If someone insults someone else they should be put on warning and their contributor privileges should be taken away. We should take a firm line on RESPECT as the basis for all online transactions including collaboration.
- The argument "I didnt cross the line" has no basis if someone is disrespectful. A log should be kept of the remarks to back up the actions just like a corporation would keep a record of borderline transgressions to support a firing.
- no user is compared to any other user. Policies are consistent and consitstenly applied. Precedence in one case becomes precedence in all. This is an equity issue. Just because someone else yelled at someone online and it wasn't punished doesnt mean I can yell at someone. Just because I speed and get caught doesn't mean everyone who speeds will get caught.
- It is made clear that anyone who supports the "wrong" side, as in the one who has not followed policy, will end up in the same shape as the person who created the mess -- that is with limits on their participation, blocking or banning. At first this will have to be extremely strict so make the point that Wikipedia is very serious about transgressions of the RESPECT and other policies, but after a while, this can ease up a bit.
- If those 20 people want to not obey the rules/policies/procedures, tell them their access to Wikipedia will be moderated.
In a short time Wikipedia can go from a community where many seem to not respect anyone to a community where people know there are rules and policies they must abide by.
The CAVEAT in this process is involvement. In the book, "The Fog at the Season's End" by Alex Leguma, about apartheid in South Africa, Leguma writes – “if the community is given the opportunity of participating in making the law, then they have a moral obligation to obey it.” “ but if the law is made for them, without their consent or participation, then it’s a different matter.””if the law defends injustice, prosecutes those who fight injustice, then I am under no obligation to uphold it.” The key to just law/procedure/policy/rules is:
- participation by the community affected
- alternatively, consent by the community for agents to act in their stead
- creation of justice, support of equity
This may sound strict or rude depending on your perspective. However, when anyone is left with limitless freedom and no responsibility to anyone else, anarchy is King. Perhaps it is time to stop supporting anarchy and time to make the community responsible to itself. After all, what good is a limitless encyclopedia that supports an online space where users are abusive to each other?
Those are some strong recommendations, but they have the potential to work.
I think that a little collective responsibility could reign in the cabals. But you have to keep in mind, they usually have 3 or 4 members who do the dirty work, and 15 members who have solid reputations to back them up. They're only human. Sometimes we forgive someone who fights hard for something we believe in, and get angry at someone who politely pushes for something we are against. So the problem isn't that 20 people are all disruptive, but that 3 disruptive people can be forgiven because there are enough good people who kind of appreciate what they're doing.
I also think that precedent could be a huge change. But there are Wikipedians who are hostile to that approach, because it's kind of legalistic. Moreover, the old Wikipedia culture (which used to work) was one where you would forgive, and give second and third chances, and assume good faith... so you always wanted to find the most soft sanction, and try to get them back to editing as soon as possible. A lot of people get a break because "oh, but he created 100 articles", or "he's been a victim in the past". People are eager to give out breaks.
I think this is going to be harder in practice than it is in theory.
These are very interesting suggestions, and are things that are being considered by the Community Health task force, which has as its mandate consideration of these things. Rather than work in "smoke stacks" of parallel thoughts, could I suggest that you glance at the work they're doing? I think you'll see a massive amount of crossover.
Well, when two or more task forces come to the same conclusions in parallel without consulting, then the likelihood is that there is a valid recommendation brewing. After all, in science, more than one team should be working on the same project to validate results.
I am writing up the Weekly report and behaviors and how to deal with them seem to effect a lot of content issues.
The morning after. I have been thinking. The problem I encountered yesterday was with what Piotrus called "true believers", the type of user that unknowingly introduces POV in Wikipedia content. There is no bad intent, we can assume good faith in them, yet they can't be trusted and will get rude when their "holy cow" is discussed. They block attempts at intelligent inquiry of the thing they believe in.
Is this the bankruptcy of AGF? I hesitate; I think not. There is nothing wrong with assuming good faith, it is a principle of civility that is vital for cooperation on any wiki project. Rather than leave this principle, I'd think of adding to it a second, more strict principle. If somebody is a true believer, he/she needs to get a topic ban immediately. Unlike Randomran, I believe true believers are often identifiable:
- They ignore others arguments in discussions or refuse to discuss them, yet keep their own stubborn positions in that discussion;
- They simply don't read sources, or simply don't read what their opponents write.
- Occasionally, they can be rude or directly insulting (however, as Randomran wrote: that's reserved for people who are stupid enough to lash out directly).
In the discussion that made me leave wp-en temporarily I can clearly show that some of the contributors were exhibiting the first two ways of behaviour. These contributors form a direct barrier for quality increase in that case, therefore an immediate topic ban would have been in the interest of the project. In most cases, this doesn't happen. Why? Because POV is more difficult to remove than vandalism. It requires more time to analyse. We're all volunteers, no admin wants to spend time on something that is likely to be unrewarding, unpopular or tiresome.
We have been talking about having a "senior editor status". I think it would help, if true believers have no access to or will be stripped of this status. It sounds harsh and elitist, but I think in the end better distinction between user types will raise quality.
+1
excellent.
this is a perfect example of how having a negative experience but turning it around to analyze it as a "problem ticket" helps all of us better understand.
@Woodwalker:
topic block for true believers with an "agenda" (even if they do not recognize it) is NOT elitist.
What is elitist is being a "true believer" because it assumes "you" know better than everyone else. Ultimately, we are all just learning here on this planet. Even world renown scientists will tell you they do not know everything about their field of expertise. Perhaps the more mature we become in knowledge, the more we realize how much more there is to know.
Your post is in line with my post about contentious users wherein Wikipedia starts to quickly identify problem users and hold a hard line about acceptable and unacceptable behavior. It is not that not everyone can play, it's that everyone can play as long as they play nicely.
I'm really glad you guys are discussing this, because now I think you're in the heart of the problem. But I think there are legitimate practical challenges here.
A true believer really tests the limits of good faith, because a true believer IS acting in good faith. They, in good faith, believe that they are helping the encyclopedia, and protecting it from an enemy. That becomes part of their defense. "Yes, they were adding original research to the article. But they believe in good faith that our original research policy is ruining the encyclopedia. Banning them would be akin to censorship. They have the right to contribute to Wikipedia." You won't even find ArbCom willing to shut down a user like that.
Furthermore, if two editors are arguing about where the encyclopdia should go, who is the true believer? The one who insists that Wikipedia needs to allow original research? Or the one who insists on reverting and removing original research? A really stubborn editor is going to get a really stubborn response... so which stubborn person are you going to ban?
I'm being devil's advocate. But I have direct experience with these kinds of editors, and you can't underestimate how hard it is find a solution.
Truly excellent points, Randomran. I distilled your points below.
Legitimate practical challenges.
- I agree
True believer acts in good faith
- I agree
True believers feel they are protecting Wikipedia from an enemy
- I agree with their perception, in light of their view point, but their perception is based on a specific perception of the BRAND of Wikipedia which is clearly not in line with Wikimedia’s perception of Wikipedia’s brand or the perception of the vast amount of dedicated users/contributors/editors/admins.
True believers believe Wikipedia’s original research policy to be ruinous
- because they do not fully understand Wikipedia’s brand.
Is banning true believers akin to censorship?
- banning anyone who does not obey the rules of Wikipedia, which are/should be in line with Wikipedia’s brand is fair as long as the rules and policies are evenly applied and equitable.
Do true believers have a right to contribute to Wikipedia from their point of view (non-neutral)?
- no, not if neutrality is a key tenet of the brand of Wikipedia. However, if non-netural POV or original research IS a part of the brand of Wikipedia, then banning them is not appropriate or constructive.
What are ArbCom’s tolerances for non-neutral viewpoints?
- My understanding is that non-neutral viewpoints are not in line with Wikipedia’s brand or mandate/mission/goal so it would seem to me that ArbCom should not tolerate non-neutral viewpoints.
If Wikipedia has no clear direction/no clear brand/goal/mission, then who is correct and who gets banned?
- Then there is no clear direction, which leaves admins, etc. in a quandary. Clear BRAND, clear direction/mission/goal is crucial or chaos reigns.
Does Wikipedia allow original research just because everyone is invited to participate? Or is banning original research consistent with the Wikipedia brand/mission/goals?
- No, original research is banned for a reason, to ensure neutrality and to ensure that Wikipedia is not utilized as a soap box or platform to promote a specific POV.
- Banning original research is consistent with Wikipedia’s STATED mission and goals.
This is a BRAND argument. Brand drives goals/mission and it directs behavior. The key here is to keep “testing” policies/rules/procedures against the brand. Does it fit the brand? Is it consistent with the brand? Will it further the brand?
I have been saying all along that BRAND drives behavior, as it drives the mission, goals, etc. Without a clear brand statement, it is easy for users to misunderstand Wikipedia’s purpose. Stating a brand, making choices is all within Wikipedia’s purview. I believe that many at Wikimedia/Wikipedia are fearful of saying Wikipedia is “THIS” for fear of leaving people out, but the reality is that everything in this world has to be something, and each something leaves out other people and things.
And ultimately, everyone knowing what the BRAND of Wikipedia is, and how it is to be deployed, i.e. neutral POV, is what makes quality content, which in turn helps to make Wikipedia the largest, most comprehensive online encyclopedia. Everyone “being on the same page” or having the same page to get onto stops true believers in their tracks because what Wikipedia exists to do, what Wikipedia is and the behaviors expected of all users/contributors is all clearly stated. Also, there is something to refer to in cases of disputes (which doesn’t really exist currently.)
So, back to my argument from last week: I believe Wikipedia does not have an identifiable brand. Sure it has the word “Wikipedia” but words and logos alone are not brands. Brands are the cumulative non-tangibles that, as an aggregate, stand for something. Brands are expressed through tangibles, like logos or content, or rules/policies/procedures. I believe that Wikipedia has ideas and beliefs that it follows. I want to see, as part of creating quality at Wikipedia (including quality content), the drafting of a brand statement – not some hollow rhetoric about how cool it is to build a comprehensive online encyclopedia, but a real, living, breathing brand statement that encompasses all the values that Wikipedia has or should have. Then let’s create policies/procedures/rules that are consistent with the brand. Then let’s create quality content that is consistent with the brand and the mission and goals of the brand.
Meanwhile, let’s do some short term work on behavioral problems, as I stated earlier, by putting in places rules/policies/procedures that are consistent with what the brand SEEMS to be. That way, we attack the problem top down and bottom up. As changes happen, and the community starts to change demographics, this will allow an “opening” for the larger changes to be put in place over time, “priming the pump” so to speak. (I cannot take full credit for all of this, FT2 has been arguing the bottom up argument with me and making me see the light of day of short term solutions to keep things “running” and changing the culture as it stands in place.)
Brenda, you say: "Meanwhile, let’s do some short term work on behavioral problems, as I stated earlier, by putting in places rules/policies/procedures that are consistent with what the brand SEEMS to be."
How would you suggest that the policies be put in place? It's not a trick question, I'm curious about that.
Governance I believe is the immediate issue. Do I, or anyone else here, make a recommendation and we apply it? Do we discuss it, do we put it to a vote?
I am going to put aside issues of governance, and assume that we just create a world that no one else will comment on, and that is the model I will work from here.
- Immediate actions
- Take all of the policies/procedures/rules and distill it down to six key principles/behaviors
- i.e. respect all other users, no original content
- it has to be short, remember-able and enforceable
- i.e. disrespecting someone is pretty clear and enforceable
- posting original content with no adequate cites is also pretty clear and enforceable
- use the “peer review” mandate to keep things like advertisements out
- if a peer hasn’t reviewed it or if there is no second, third or fourth source backing up information, it can probably be treated as a primary source
- Make this “distilled list” available all over Wikipedia
- It can optionally be a term of participation, i.e. a screen that comes up and is agreed to in order to read/contribute (I know this seems contrary but at least you know there is a tacit “agreement” even if they don’t read it)
- Empower all admins
- Three warnings rule
- Warn – regular “voice”
- Caution – a bit “louder”
- Last chance – the equivalent of “yelling”
- After the third “warning” the user is blocked
- Remediation by admins
- Explanation by admins of applicable rules
- Apology from blocked user
- “second chance” if appropriate
- If no “second chance” appropriate, consideration of ban
- Three warnings circumvents the “ignorance of the law” concept
- People are fairly apprised
- They are given ample time/opportunities to change unaccepted behaviors
- They are treated fairly and treatment is also consistent
- Fair and even application of this is key
- No outs even for “key” people
- No variance, no wavering
- All admins have to comply with this, no “outs” or they cannot admin
- Three warnings rule
- Change the procedure for creating Wikis
- Any topic can be a wiki if it meets the guidelines – this is good
- Any one can come up with an idea for a wiki
- The user creates a discussion page first
- Discussion is additive with no editing of any post
- This forces people to be more careful in what they post
- This also forces the “history” to be public and easily read/interacted with, rather than someone you have to know how to use
- No users can overwrite anyone else
- admin watches over the discussion, guides and facilitates, and uses the three warning rule
- After all the discussion/arguing/culling information has been done (this may take a while), the wiki is created
- On the wiki is only that which fits Wikipedia’s guidelines
- Verifiable
- Neutral
- Any other information can be noted in the discussion for possible inclusion in the wiki once it is vetted
- The wiki is, as usual, editable, except in the cases of truly contentious discussions, which can be locked, and additions to locked wikis can go through the “discussion” process
- This turns the process a bit inside out
- The discussion takes place and then the wiki
- Instead of the wiki exists, then let’s discuss it
- It is closer to the process of say building a house or normal planning for any project
- It utilizes teaming, collaboration and planning
- In the wiki world I am proposing
- everyone can learn how to collaborate in the discussion
- the rules are clearly communicated
- some sort of loose “team” is created
- trust is built in the discussion process
- by the time the wiki exists, there is something to build on, factually, and in community
- the current process brings together anonymous people with no/little trust and that in itself gets in the way
- the trust that is built in working through problems will provide cohesion when the actual wiki is posted
- that trust/team/collaborative effort will help in and of itself to ward off potential problems once the wiki is posted if things go “wrong” (vandalism, non neutral POV additions/changes)
- the downside is that a team is built and then needs to open up
- the upside is that everyone learns
- there is a shift from just giving/contributing to a focus on teaching/educating/mentoring (perhaps more in line with the perception of the current brand of Wikipedia)
- this helps to make less competition and more collaboration/teaming (also perhaps more in line with the perception of the current brand of Wikipedia)
- Take all of the policies/procedures/rules and distill it down to six key principles/behaviors
I think this is a good place to start.
My point in asking how you'd make the policy happen wasn't rhetorical. It seems to me that if this group proposes a bunch of policy shifts and they prove to be impractical because there's simply no way to change the policy, then it's wasted effort on everyone's part.
It's important that recommendations be actionable (and it's also important that we say who the party is that can take the action"). For instance, I see almost no way for the Board of Trustees or the strategy plan to force new administrative policies on any project, nor should they, in my opinion. With very very few exceptions (cases of privacy, etc), the Board and Staff don't create policy. To do so would violate what seems to be a core belief in project self-governance. Maybe that should change. If so, it should be a recommendation from one of the task forces.
But to create a hypothetical world with zero chance of being enacted is not helpful, probably. I think it's best if we focus on what can be done. It may be that one of your recommendations (or Community Health task forces') is that the English Wikipedia select a team of editors to rewrite the policy on X, Y, or Z. That makes sense. But us attempting to impose a series of rules is likely to end in rebellion or (worse) out and out rejection of them because the community's cultural mores (yes, Brenda, the Brand) was not respected and honored.
That's why I'm saying this is delicate work. We can't start from a zero basis point, because we already have some policies in place. So, ideally, I'd like to see this task force take a deep dive into those policies that affect content quality and determine where the conflicts are, how to resolve them, a path to resolution, etc.
We can't pretend there aren't already policies in place, and they're policies that are worked with daily by about 1000 administrators and hundreds of thousands of users. There's going to have to be a migration path, practically speaking.
@Philippe: I accept the fact that there are guidelines in place already. However, all major Wikipedia projects have different guidelines and problems due to a different culture and way of working. Advising wp-en to appoint a commission to rewrite a certain guideline is a good practical idea, but can only work for that project. Wp-de has different problems. As we have only 2-4 recommendations to make, I would prefer to make them beneficial to all projects. On the other hand, we shouldn't be too general either. How to solve this paradox?
@Philippe
I am going to apologize up front if this seems disjointed. I am exhausted and it’s been a rough day. The last thing I needed to read was something that seemed like double speak to me – “here, brainstorm, but do it quickly.” Brainstorming is a time consuming process, especially when people are volunteers and have lives. I feel I am having to repeatedly explain things that should be self evident. Unfortunately, much as I wish to continue on this project, if the PM's don't understand or support where I am trying to go, then it makes it difficult to feel there is a point to my continued contribution.
That said, I will try to explain this in more detail in case I made assumptions I should not have made.
My thoughts:
It takes guts to stand up and persuade people that what you are suggesting for them is right for them. It also takes grounding in the background tradition or brand. My suggestions are gutsy and they are grounded in both the principles of Wikipedia and its brand.
Saying that it’s a wasted time to brainstorm on ideas to fix the massive problems that Wikipedia is experiencing if we are not sure they are actionable is a total loss of faith. How many nonactionable ideas did the Wright Brothers work on before they finally flew their first plane? I don’t know, but I have seen a few of them in the Smithsonian. If they had not wasted time thinking about something everyone else said was non-actionable (flight) none of us would be flying today.
There is no reason to create any actionable recommendations until we can all agree on certain end results we are after such as: if all users respect each other we will have better quality content. This might be followed by admins having a three warning rule for enforcement of respect. That might be followed by a policy of how we give admins that responsibility or how we teach the community to accept this flows from that. However, agreeing that all users have to respect each other no matter what is the first step. We are barely at that step at this point. Asking for us to be three steps down the process chain at this juncture isn’t appropriate.
In my own defense, in your post you didn’t give me the same direction you are now sharing. Also, this is the first I am hearing about what you expect, as far as how the recommendations should look or at what level they should be. Honestly, that should have been communicated up front.
Now, in defense of my suggestions:
- What I have suggested is rational and sane.
- It takes into account existing brand and existing polices/procedures/rules.
- It makes it immediately clear that something is changing, which helps people who are fed up with the problems at Wikipedia and which gets the media off Wikipedia’s back while they watch and wait for Wikipedia to lose more editors/contributors.
- It answers the need of most of the constructive editors/users/contributors to have a safe working space, and communicates that we take their needs seriously.
How about before I go back over these points and make them actionable, we get some feedback from the rest of the taskforce to see if they think:
- They make sense, given everything we have discussed
- They seem reasonable for Wikipedia
- There is some agreement about taking the time to make them actionable
- They seem to reflect the current and perceived brand of Wikipedia
- Streamlining existing policies and giving them “bite” makes sense
- That distilling existing policies creates a migration path
Rebellion? Wikipedia is ALREADY experiencing a wide spread rebellion. When people like me refuse to contribute because of the climate on Wikipedia, there already is a big problem. And people like me are just the tip of the iceberg. It is all the rest of the people who want to contribute who are much less experienced with the online workspace who avoid Wikipedia completely except to read it; or the college professors who marvel at how inaccurate Wikipedia is – which is far worse than people not contributing because it denigrates the brand in front of millions of students every year. In fact, the comments from professors may be even worse than all the users we may piss off.
The people who care about what Wikipedia is and what it was meant to be may be smarter than you think when it comes to understanding enforcement of existing policies. The people who will likely rebel the loudest are the people who are vandalizing and spreading non neutral POV. It’s not like this is a free speech area where rights are respected. They cannot yell about Wikipedia denying them free speech – that is not a right on Wikipedia due to its mandate as an encyclopedia. So are you saying that Wikipedia is worried that people will say “Oh, no, you cannot curb my right to do X?” Wikipedia already does, it’s just that nobody enforces it. Wikipedia is already a hostile environment. What are you taking away from them if you ask them to abide by some modicum of civilized behavior?
In order to process all of this, I wrote down everything I did as a PM to write a PM manual for a company I worked for. I made myself rethink the process of engaging everyone, defining scope, etc. The way you make policy happen is to talk to al the stakeholders and find commonalities. Then you agree on the end point you are going towards. Then you back up a bit and figure out how to get to that end point. Then you figure out how to get people to buy into the process it takes to get to that end point, if they have not already been involved in the process.
It seems to me that we keep getting pushed to jump a logical step in the process. It took Wikipedia how long to get into this mess? Can’t we have a little more time to figure out how to get Wikipedia out of it?
Let’s wait for everyone to weigh in first. Then we can hopefully agree on some of the ideas and figure out how to make them actionable. Personally I do not think admins enforcing rules in a volunteer community with a shared purpose when the rules make it easier to do your “job” will create a rebellion. I think, as I said above, that Wikipedians are already rebelling. . The Wikipedia brand doesn’t say “we wont have any rules.” The brand says “we will be the best, most comprehensive online encyclopedia.”
Brenda, if I had more time to offer you, I would gladly do so. Unfortunately, I don't.
The strategy project is funded to a particular dollar level, and the Board needs recommendations by a particular time in order to meet the financial planning requirements for the next year, so that they can allocate our sparse resources. It is, quite simply, a hard deadline. Unless someone comes up with the $$$ to extend the strategy project, we have an obligation to have recommendations ready to go in mid-January. That's not a "soft" deadline, it's a very firm one.
I'd love to give more time for this to be worked on, but the time simply isn't there, because the project's funding evaporates, and the Board does this time of financial budgeting one time per year, in order to publish and meet the budget. There's simply no additional time to give. The deadline is mid January.
Sorry.
I'm actually really sympathetic to your vision. But as someone who has tried to fix policy and fix the culture, I think you have to recognize just how hostile that Wikipedia has been towards authority, and it's a more than a significant minority. There are already numerous people who feel that we shouldn't have administrators, let alone arbcom... or at least that we shouldn't entrust them with very much power. Arbcom is absolutely terrified of tackling any content or policy issue, aside from enforcing the behavioral norms that already exist. And they're elected by the Wikipedians! Can you imagine their reaction if a few random Wikipedians on an unelected task force got to change the rules to whatever they thought would work? There's no way that the trustees would back it. For better or for worse, it's a non-starter. (And I honestly believe it's for the worse.)
So knowing that the trustees are not going to make Wikipedia a markedly more authoritarian place... what can we get the trustees to do? Maybe empower some administrators? Create some processes that will let the community settle issues more effectively, so that true believers will have a harder time obstructing the process? Change the organizational structure a little?
We have to take a surgical approach. Can we achieve a big impact with something small and strategic?
Hmm... I just had another thought.
Given that most of what you've suggested isn't so radically different from what the vast majority of administrators do every day (multiple warnings, etc), I wonder if it would be at all helpful to you (as someone not deeply involved in the administrative culture) to follow me around as I do an administrator shift? I'd be glad to take an hour or two and do a shared screen with you (we can do that on skype) so that you can see what the current culture for administrators (or at least the ones who are - like me - I think the silent majority) is.
I'm not 100% sure that you're operating off a totally informed viewpoint about what administrators do, because I'm not sure you've walked the mile in their shoes. I still have administrator rights on the English Wikipedia. We could set up a telephone call or a shared skype-cast so that you can see what it's like... would that be helpful to you? I think you'd find that some of your ideas are exactly what the vast majority of administrators do on a daily basis.
I'm just trying to come up with a shared understanding of the role...
Philippe
Philippe --
as a volunteer, Wikipedia may just have worn through my last nerve.
I am going to anger some people and frustrate some people, so if feeling good right at this moment matters more than hearing what I have to say, you might want to skip this post.
Let me put together a timeline:
August, Bridgespan/Wikimedia meet for a strategy session. November, I am asked to be on this task force and facilitate. I receive no comprehensive list of URL’s to familiarize myself with, Two weeks later I am expected to help shape 2-4 recommendations. These recommendations are not end results, they are recommendations of how to affect results that in 8 years of existing, Wikipedia has yet to be able to produce.
There is an incredible disconnect not only in what is being asked of us, and how it is being asked of us, but of the timeline itself.
As far as I knew, the recommendations were due mid January, not today. (And this is the first I am hearing that this is a hard deadline.) Despite the due date still being a month away, we are being pushed to create hard and fast recommendations on how to affect results two weeks after joining this team, with no support to get up to speed, and using an interface that is clunky at best.
Here comes where I piss people off. However, if what I say is true, then it existed before I showed up here and will continue to exist after I am gone.
This project is poorly managed. It may even have been poorly concepted if Wikimedia thinks a volunteer task force that has lives of their own will in less than two months go through a think tank type of process and come up with the type of recommendations it says it wants. If Wikipedia hasn’t been able to do this in 8 years, how are we supposed to do this in two months?
In addition, and please correct me if I am wrong, Wikimedia has not reached out to a diverse demographic as project managers. We need people who know how to nurture and support the team, including providing everything we need to do our “job” especially if there are tight deadlines. We need both men and women who are experienced project managers who work in a change environment. Two of my past clients, both ex IBM-ers, do this. They did it at IBM and then they did it for large organizations like HP. I am well aware of the type of skills that change management takes. It is not apparent in the exchanges that our PM’s have this kind of background. Yet that is the demand of the task forces: change management masquerading as content quality or health of community or…
I have been around long enough to know that if something smells like a fish it is probably a fish. At first I thought it was me, then I thought it was my newbie status. Then I started realizing that Wikimedia is asking volunteers to roll a rock up a hill in a hurry. Why? Not because it’s the right thing to do and will best serve the project, but no, because they need to know how to budget money.
How about this? This is my recommendation:
Wikimedia needs to work with a brand consulting agency, preferably someone like Al or Laura Ries who really knows his/her stuff. That is probably where the budget should go. Then after Wikimedia has engaged in the correct process to assess, qualify and state its brand (which may take a little time given there are millions of stakeholders all around the globe and Wikimedia seems to want a totally inclusive process) Wikimedia can strategize how to reenergize its base, get all the users on the same page and iron out all the horrible messes that it has allowed to happen with its Holly GoLightly attitude that everything will work out fine if everyone just has access and a say. This is the part where the change consultants come in. Once Wikimedia strategizes about base, users, contentious users and the like, then it can put policies in place like a responsible brand so that the brand is consistent (and the content quality is consistent and the user experience is consistent) across the many projects.
Right now, Wikipedia is adrift. It is a great idea waiting for a group of people ballsy enough to say “hey, well that really didn’t work, but the idea’s great so how do we save the idea?” Willingness to admit that you have made a mistake is frequently the first step towards enlightenment on any project. Until adequate time is given to process driven and framework (brand) conscious solutions, it is just another bandaid and you are wasting the time of your volunteers.
I am a full time student, a single mother of a disabled child and have a number of disabilities myself. I am trying to get through finals. In addition, I am involved in my community, I am mentoring a teenager, I am teaching someone how to start a business, and I am doing a lot of other change work. I have time to give when it is appropriately utilized, but I do not have time to waste on poorly concepted projects.
You cannot save Wikipedia in sixty days. And you cannot expect results in two weeks with a team that doesn’t know each other. Time to grow up and face the music: not only are you going the wrong direction, you have not structured the journey properly.
Feel free to ban or block me. At this point, while I am still interested in how this turns out, as I said above, Wikipedia, as represented by the PMs, the time table, the unrealistic expectations, has worn through my last nerve.
Randomran:
surgical and elegant take time and familiarity to form. I have neither. And in reality, it really isn't what is needed.
In addition, if Wikipedia really wants to be the best online encyclopedia it may just have to suck it up and admit that it needs rules and regulations and policies and procedures to ensure a livable workspace.
It's funny, you go anywhere else offline and psychologists and psychiatrists will tell you that people need boundaries. You study Political Theory, Kant, Rawls, Dworkin, etc. and you will find out that in civil society there has to be balance so all can work together. But somehow, Wikipedia thinks a huge project can function without the rules of civil society and self regulate with no offset for greed, etc. Anyone hear of the Tragedy of the Commons or the Prisoner's Dileman. I am certain there are Wikis on both, as well as Rawls. In fact, Rawls' 1984 book, I believe his last, talks about what society can do when the opinions of its citizens are so divided, how overlap can be assessed and it can be utlized to create just institutions that create just law. I actually talked to Dr. Kaufman about its application to communities like Wikipedia. However, trying to explain it to you guys, after watching this task force take two weeks to approach the concept of brand, and when I am being pushed to focus only on recommendations, is probably pointless. If you want to look it up, chekc out teh Wiki on Rawls which should list his last book. However without reading "A Theory of Justice" you might be lost.
The irony is that my entire life is about social justice and upholding rights. I just don't believe that veritable "home rule" at Wikipedia is consistent with its brand or its mission. And I do not believe in any of us not being able to participate because Wikipedia refuses to enforce its own rules.
thanks.
I can really empathize. Things are a little crazy in my life right now, and it's hard for me to imagine that this strategic planning process can be effective in a short timeline. The process can be frustrating at times, without much guidance. But we have to do the best that we can.
I agree that the lack of boundaries has actually hindered Wikipedia, because it has become tolerant of too many problems. But how many new boundaries do we need? That's the key question.
If you want to program a flock of mechanical birds to fly in a realistic way, it's tempting to get really complicated. Birds must follow a leader. To avoid everyone crashing, you create a hierarchy. Bird one takes the lead, bird two and three follow close behind, until you create a flying V. They must follow the trajectory. They're not allowed to stray too far. To create realism, randomize the velocities and distances within a tight range. Randomly swap their places on occasion.
But one thing computer scientists figured out was that you could actually achieve flocking behavior with a few simple rules: steer towards the average heading of your neighbors, and avoid crowding. Somehow, these two rules manage to create a very realistic flock of birds.
I think the lesson is that yes, task forces will need to produce new rules. But can we find just a few rules that have a huge impact?
I'll tell you my theory:
I think we can empower the community to solve its own problems. In theory, the community should have been able to come up with solutions that improve quality and weed out disruptions. After all, the community can change policies whenever it wants! But something has gone wrong with our community's processes. Maybe the processes didn't scale very well to the explosion in volunteers, or maybe people have found new ways to abuse those processes. But either way, the processes broke down, and the community could no longer adapt to new problems. I think the most effective thing we can do is fix the processes so that the community can adapt once again.
We don't need to direct the community's evolution. We simply need to remove the obstacles that are preventing the community from evolving on its own.
That's what I mean by a surgical approach.
Then you are saying that the brand of Wikipedia is:
"the largest most comprehensive online encyclopedia built by a self governing, self correcting community"
Up to now, wikipedia has said: "the largest most comprehensive online encyclopedia" and mention of the community has been omitted.
Do you see how knowing your brand drives your actions?
And, I don't really care about the "best we can." I care about doing it right. And if doing it right is distilling all of this down to the two rules that will get the flock to "fly right" then I believe that the task forces should have the time to figure those two rules out. I also believe that if, across task forces, we are all coming up with that the solution to quality content is that everyone needs to "fly right" that it is foolish to continue to focus on "quality content" as a subset and force the "answers" down that path. Instead, the different groups should shift their focus to figuring out the two rules to get the community to "fly right."
I really dont care what I work on. I care that:
- things improve
- I am treated respectfully
- things are set up correctly
- the right focus is supported
- the process is given the time it needs to proceed (see: treated respectfully)
As far as I am concerned I am chalking up this task force to more of Wikipedia doing things badly. Instead of rethinking the process, as I had posted earlier, Wikipedia is using the same process that doesnt work with the same community and expecting a different result. I think that is the definition of stupidity. (doing the same thing the same way but expecting diffrerent results.) THAT breaks good faith, as far as I am concerned. I didnt expect more of the same.
So in summation, you, or Wikipedia, is expecting out of the box solutions using the same methodology and the same ocre demographics. Can no one else see what is wrong with this?
I sympathize that it's frustrating. In my career, I'm actually very used to putting in recommendations that won't be acted upon. "Too costly." "Too big." "Just not where we were planning on going." You're often lucky if you get a reason. It's happened so many times that I can no longer be frustrated and cynical. I'm now strategic and cynical. :)
Change and politics are unfortunately intertwined. How do you get a giant to move? Very slowly, and only if you can trick them into believing that's where they were already planning on going.
for 2 1/2 yeas I have been moving a university of 33,000 students and a recalcitrant administration. Yes, it can be slow. In fall 2010 I will be undertaking a five month six credit hour research study that will examine just this question, but in light of the university obeying and following existing law. I am studying this from sociological, psychological, political and anthropological view points. I understand how massive the undertaking is.
Now, if I would take five months to do actual research (original and secondary) prior to making recommendations of how to and why to move a giant of about 50,000 people, then why wouldn't Wikipedia give more than two months to move its giant of millions of people?
I plan to graduate from this university and then go to law school here. In addition, I intend to practice law in this state and it is a state run university. So, there is an incredible amount of impact that this project has in my life. I have to weigh what impact the politics of Wikipedia have in my life.
Thanks for the support.
I fully agree. We would want to spend this much time just in the research phase, and spend 100% more time just working out the recommendations. But under the circumstances, we can only do our best.
Good luck juggling your school and family life. It's gonna be tough, but I think you'll find your experience very rewarding. Especially working in social justice.
I would function very well on the encyclopedia you envision, and in a selfish way I kind of hope you are persuasive.
But there are two problems.
The first is that a lot of these issues are gray. The obvious POV pushers and original researchers don't survive on Wikipedia. The most disruptive ones can survive on Wikilawyering and the support of a good cabal. Someone relies heavily on a company's press releases to write an article that promotes their product. Someone tries to delete it as original research, and as an advert. They respond that "the information is verified, and it's written in a neutral tone instead of an advert." All hell breaks loose over an issue like that. Have they crossed the line?
The second is that policies in Wikipedia are descriptive, not prescriptive. *Anyone* can rewrite policy. It's not like they're etched in stone by the Gods, or even the founders. Policies change. Is it fair to exclude someone because they disagree with a policy the way that it is now? What if they fight that policy tooth and nail, and swear up and down that we should "ignore all rules" because they truly believe they are enhancing the encyclopedia? Are they being disruptive? At what point do we ban them? ... how do we know that policy won't eventually change where it supports their position? Should they be invited back? Should we have banned them in the first place? Should we now crack down on the people who support the old policy? What if those people start pushing the old policy wherever they can, turning multiple articles into a battleground?
In spite of all those practical challenges... I still feel like there is a difference between someone who is opinionated and someone who is disruptive. But I have a hard time figuring out where to draw that line. And so it's hard to start banning people on that basis.
@Randomran: in my experience, the difference is always in behaviour. The user that edits without paying attention to others creates problems, the user that discusses and listens first doesn't create problems. Weather they are opinionated or not isn't particularly important: the disruptive guys aren't always the opinionated guys. I believe that when discussions follow the form of intelligent inquiry, consensus will eventually always shift towards higher quality (more neutral, more balanced). It's the contributors that prevent intelligent inquiry (by being rude, by editing against the consensus, etc) that form the real barrier.
I am opinionated in many subjects, so are all of us. Yet I keep that in mind when I edit, or simply don't edit the subjects I think I'm not neutral in.
+1
Test case: use my behavior on here as a new user. (yes I am handing out darts)
I am opinionated.
I have done original research on brand.
I am vocal and I am also tenacious.
I have offended at least one person on this task force.
Am I disruptive?
Note: the brand graphic I posted is based on years of reading/research and on other people's work as well but it is not cited because for the most part it is common knowledge in my field.
What is different about me or my approach than users all of you would call disruptive?
Honestly, I'm not sure.
How offensive is it? Obviously "shut up!" or "you're an ass" is not civil behavior. But is it offensive that the new user saw something they thought was untrue and said "stop pushing lies on Wikipedia. I'm removing your lies." Is it offensive if the new user said adamantly "listen, I'm an expert on this, and you need to step aside"?
And how original is the original research? If it's blatant, then that's a strike against you. But what if there are lots of people on the Wiki who think it's fair game? An admin comes down on you... and like many "true believers" do, they pour into the discussion and overwhelm the admin. They point out that the new user used a press release, or an advertisement, or a polished but self-published website. You point out that this is still original research, and they no it's not, and "ignore all rules" anyway.
... you're going to have a hard time dealing with anything but the most obvious vandalism. What makes "true believers" so disruptive is that they think it's enough that they wrote some grammatical sentences that are on topic, and there are plenty of people who will say that's fair game.
I am only going to address policies, I addressed users below.
If policies derive from the brand, they never stray too far before people go "HEY! That's not consistent with the brand! (I.e. thats not how I should be treated, that's not how it should be done, etc.)
Different than that, is that brands change over time. From time to time, a new brand statement may be in order. Having a brand doesnt mean it doesnt evolve. In fact, most brands DO evolve over time or they cease to be competitive -- in our world that wouldnt mean market share of dollars/Euros, etc. In our world that would mean a loss of contributors/users/editors/readers.
The policies of a brand can also change over time to respond to an evolving brand.
One of the nice things about Wikipedia is that it is not static. However, in order to have consistency and equity (a key thing for me) there has to be some consistency. Eventually, standing on quicksand wears out even the most intrepid traveler.
I finally grasp in its full width what Bhneihouse means by "brand". It's similar to my own emphasise on "factors of quality" and having neutrality and balance included in that list. In fact, what I did was similar to defining a brand then.
Is banning true believers akin to censorship? No, it is not. Why would we only block/ban users for vandalism, while that is the most easy way of destroying quality to recognize? Edits that kill neutrality and/or balance are by far worse, because they are so difficult to recognize. We should be prepared to be at least as punitive in such cases. That said, I'm always in favour of second chances, and third, as long as the user shows to have gained insight in why his behaviour was wrong.
PS: the arbcom I served did explicitly never judge in matters of content. They would never block or ban a user for vandalism or other edits that destroyed quality. I just found out the English arbcom has a much wider mandate.
@Woodwalker
You made me a very happy woman.
I agree that non neutral/non balanced edits are worse than vandalism because they are insidious and sometimes hard to recognize. Perhaps it is the difference between outright racism and subtle racism. In a way the second is worse -- perhaps because it actually takes more effort to do it or perhaps because it is more difficult to recognise, I do not know. But what I do know is that anything that is inconsistent with Wikipedia's brand and resultant purpose/mission/goals does not belong on Wikipedia.
If quality content is part of Wikipedia's brand then behaviors that affect the quality of the content are not permissable.
Thank you for taking the time to read what I post and working with the information. Your effort makes it worth the time it takes to post it.
Woodwalker; Please see this link. I think this partly explains why there is so much discord on Wikipedia. People read too much or too little into what is being said, or they just don't grasp intended subtleties because the reader applies there own emphasis on words and interpretation based on their own state of mind. The writer's vocal and physical cues are cut out of the conversation. Misinterpretation quickly escalates into arguments and negative behavior. I find it is critical that I divorce myself from all emotion whenever I write or read something on Wikipedia. Even if the other person is blatantly aggressive, rude, or mean, I just stay calm and focused on the point I am trying to make, and I ignore any comments that don't pertain to the discussion at hand. I do agree that people with poor critical thinking and communication skills make any discussion much more difficult and challenging, and sometimes it seems futile to keep trying. I also try to keep in mind that even though I consider my skills to be relatively good, there is always going to be someone who has much better skills, and that person might find me frustratingly dense. MissionInn.Jim 19:53, 4 December 2009 (UTC)
Thanks! This place isn't meant to discuss my personal experience of course, but nevertheless thanks for your remarks. Perhaps it can serve as an example why contributors get disappointed in Wikipedias. It's not that I don't see the reason to contribute anymore, I still see them and will of course return. It's not that I crave attention (en:Wikipedia:DIVA) or want to see people supporting me in the particular topic at hand. It's the simple fact it's no longer a nice hobby. When that personal border is crossed it's just time to take a break.
Everything you mention is true. I'm usually the patient type in discussions, trying just to say what counts and ignore it when others don't read/get it. Yet, if we really want to be able to raise quality to a higher level than the ruder part of our contributors is able to understand, we have to somehow get over the barrier of discussions being decided by ignorance and self-over-estimation.