[Wiki Loves Monuments] Jury criteria, membership, process, and tools for WLM 2016

Mon Sep 26 13:23:00 UTC 2016

Hi Cristian,

On Mon, Sep 26, 2016 at 2:19 AM, Cristian Cenci <cristian.cenci at wikimedia.it
> wrote:

> Hi Lily,
> thank you for all the istructions.
>
> Italy is organising the jury. We have a large amount of pictures, so we
> will have a preliminary phase of pre-jury, and than a meeting with the
> final jury, made by expert wikipedians and famous photographers. You will
> know the 10 winning photos until the term of 25th October.
>

No problem. The tools can accommodate for this easily. It sounds to me that
all you need for this to happen is a few people other than your core jury
going over the yes/no round (or possibly multiple yes/no rounds) to reduce
the number of photos from more than 15K to 400-700. My only suggestion is
for you to have this team of people ready (know their Wikimedia user ID,
and ideally their email address) by September 30, so you can start on
October 1. :) I'm happy to brainstorm with you more about the specifics of
the yes/no round in your case, but let's take that offlist. (Send me few
days/times that work for you and we can have a quick Hangout/Skype chat.)

> I didn't organise this phase in the last edition, so every help with the
> tool is welcome (I'm not an expert in programming or complex wiki-tools,
> but I can trust in Nemo's support ;-) ).
>

As a general rule of thumb: if you have Nemo, you have no worries. :)

Re the tools: they are designed in a way that you won't need to know
programming to work with them. They are supposed to be easy to use. Again,
any help you need, please ping me. You will not be blocked on not having a
tool available for you to start your jury process. :)

Best,
Leila

>
> Best regards,
> Cristian
>
>
>
> Il 26/09/2016 11:07, Ilya Korniyko ha scritto:
>
> Hi  Leila,
> Ukraine will not be able to submit photographs by October 25.
> We need a month for jury work till November 1.
> Regards,
> Ilya, on behalf of the WLM Ukraine organizing committee
>
> On Mon, Sep 26, 2016 at 7:50 AM, Lily <lilyofthewest.wikimedia at gmail.com>
> wrote:
>
>>
>> Hi all,
>>
>> If you are a WLM organizer, jury coordinator in the national level, or a
>> jury member, this email can contain crucial information for you. Everyone
>> else, you can safely stop here. :)
>>
>> This email contains some best practices on how to run your local jury
>> process with regards to criteria, jury membership and process. Finally, it
>> includes some instructions on how to choose your jury tool.
>>
>>
>> Timeline
>>
>> You should plan to start the jury process as soon as the competition ends
>> in your country, this is October 1 for many of you. :) The international
>> team expects to receive the top 10 photos of your country no later than
>> October 25.
>>
>> Judging criteria
>>
>> While every national competition can choose the judging criteria based on
>> the specific needs of the country, the international team recommends the
>> following three judging criteria to be considered in the country-level jury
>> processes: technical quality, originality, and usefulness of the photo for
>> Wikipedia. If you are interested to learn more about these criteria, please
>> read more about the judging criteria
>> <http://www.wikilovesmonuments.org/judging-criteria/> that the
>> international jury will be using as explained in this blogpost by Lodewijk.
>>
>> Local jury set-up
>>
>> National competitions typically have a jury with at least 3 members (the
>> more photos, the more jury members). The local jury set-up is usually
>> defined based on the judging criteria you will choose to go with. The
>> international team recommends that, depending on the number of photos you
>> expect to have by the end of the contest, you have 1-3 Wikimedians (maybe
>> those with quality/featured images on Commons), 1-3 people who are familiar
>> or are experts in the heritage of your country (especially the monuments),
>> and 1-3 people who are professional or (quality) amateur photographers. Of
>> course, all jury members should be excluded from winning prizes awarded by
>> the jury.  The national jury can then nominate maximum 10 photos per
>> country for the international finale.
>>
>> Jury process
>>
>> The jury process on the national level is defined by each country. The
>> international team recommends the following process:
>>
>> Round 1: Yes/No or rating
>>
>> The goal of this round is to lower the number of competing photos to
>> 400-700. If your total number of pictures is less than 500, you can skip
>> this round.
>>
>> Jury members are asked to vote yes/no for each photo they are shown and
>> are requested to stick to a maximum number of ‘yes’ votes (for example,
>> 500). Based on these votes, a set of 400-700 photos is selected for the
>> next round. If you have many photos, you may have to do this round in two
>> steps.
>>
>> Round 2: Rating
>>
>> The goal of this round is to come to a selection of the top-50 images.
>> Jury members are asked to rate/score each image with 1-5 stars. Based on
>> the average from their votes, the top-50 is selected for the next round. If
>> there are many pictures with similar scores, the coordinator can choose to
>> select a top-40, top-60, etc.
>>
>> Round 3: Live meeting or ranking
>>
>> The goal of this round is to arrive at a final ranking and winning
>> pictures. If geographically feasible, the jury can meet in person. The jury
>> tool supports an alternative method: ranking. Each jury member is asked to
>> rank their favorite 20 photos in order. Based on this ranking, points are
>> awarded to each photo (20 for the number 1, 19 for number 2, etc). The
>> total number of points determines the final result. Jury members are also
>> asked to give a reason for selecting their top images. You can use this
>> latter information to explain explain why the winner was selected, an
>> information that can be useful for your jury report and press releases.
>>
>> Jury tool
>>
>> Unless you have a very small number of submissions (less than 100), it's
>> usually efficient for your jury to use one of the available tools
>> <https://commons.wikimedia.org/wiki/Commons:Jury_tools> for judging the
>> photos. The international team would like to bring your attention to two
>> tools: ‘Montage’ and ‘WLX’. Below you can find more information about
>> these two tools. We suggest that you look into these tools now, and make
>> your choice soon.
>>
>> Montage
>>
>> Montage is the new tool that has been developed this year by volunteers
>> and per the request by the WLM international team. There are two features
>> of the tool that are worth pointing out: The tool is designed and developed
>> in a way that can accommodate the recommended jury process explained above
>> (yes/no, rating, ranking features are supported). The developer team will
>> also guarantee to provide timely support (within 24 hours) starting October
>> 1.
>>
>> If you're a national jury coordinator or a jury member and want to test
>> the current version of the tool, please leave a note on the tool’s
>> discussion page <https://commons.wikimedia.org/wiki/Commons_talk:Montage>.
>> If you want to have a 1:1 conversation with one of the developers, please
>> leave a message using the same link. You should feel free to leave
>> questions/comments about the tool in the same page. If you are familiar
>> with GitHub, you can also create issues on GitHub
>> <https://github.com/hatnote/montage/issues>. Please note that the
>> developers will continue adding features and smoothing the workflow until
>> October 1, what you will test now will give you a sense of the basics you
>> should expect. :)
>>
>> What is essential for you to be able to start the jury process on October
>> 1 using Montage is the Wikimedia usernames of your jury members (if they
>> don't have an account, please ask them to open one). If you decide to go
>> with Montage, please gather this information sooner rather than later.
>>
>> WLX
>>
>> You can learn more about the tool here
>> <https://commons.wikimedia.org/wiki/Commons:WLX_Jury_Tool>. The tool has
>> been used by many countries as part of WLM and WLE contests in the past
>> years. If you're interested to use WLX, please contact Ilya (WLX's tool
>> developer) in the tool's talk page
>> <https://commons.wikimedia.org/wiki/Commons_talk:WLX_Jury_Tool>.
>>
>> If you have any questions or comments, please don't hesitate to ask them
>> here or off-list.
>>
>> Best,
>>
>> Leila
>>
>> --
>> User: LilyOfTheWest
>>
>
>
>
> _______________________________________________
> Wiki Loves Monuments mailing listWikiLovesMonuments at lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/wikilovesmonumentshttp://www.wikilovesmonuments.org
>
>
> --
> Cristian Cenci
> Project manager Wiki Loves Monuments Italia
> Coordinatore regionale per il Trentino-Alto Adige | Regionalkoordinator
> für Trentino-Südtirol
> Wikimedia Italia – Associazione per la diffusione della conoscenza libera
> Tel. +39 393 8005889 | cristian.cenci at wikimedia.it | www.wikimedia.it
>
> _______________________________________________
> Wiki Loves Monuments mailing list
> WikiLovesMonuments at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments
> http://www.wikilovesmonuments.org
>

-- 
User: LilyOfTheWest
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/wikilovesmonuments/attachments/20160926/c1b67c52/attachment-0001.html>