Increasing transparency on a BN application's status
Reworking BN application s
Platform for communication between NAT and applicant post-application
These seem like good changes and are definitely long overdue so it's nice to see them added. My only concern is that individual from each evaluator could potentially be inconsistent, contradictory or confusing due to different views, so when making these comments available to the applicant, it would be important to make sure that they're easily understandable and not conflicting with other evaluators, and to adjust them if necessary.
Removing the RC test
I'm not sure how I feel about this one honestly. On one hand, it is indeed a tedious test for applicants, and maintaining it is probably tedious for the NAT as well. But on the other hand, it might still be a valuable tool to determine knowledge/comprehension about the ranking criteria, BN rules, modding code of conduct etc. While it's true that looking up the answers is possible, it still teaches people about these things which they might not even read or know about otherwise. Therefore it could be seen more as a lesson than an actual test, which I don't think is bad. Whether it helps filtering out incompetent candidates or not is another story and it's hard to judge without knowing how many people are ing/failing the test. Assuming that the vast majority of applicants the test, perhaps increasing the threshold for ing could be an option to make it a more efficient selection process. Adding more questions that really test the person's knowledge, understanding and judgement could also make it more useful.
Reworking BN applications
First I want to address the proposed changes and some of the comments posted in this thread so far (I will talk about other issues and my own suggestions in a separate post later).
I was anticipating bigger changes, but I suppose all the talk about it just blew them out of proportion. I genuinely don't see much of a difference between this and the previous format, there are still 3 maps of different quality to submit and comment on. The questions are slightly different but still similar, so I guess the main difference would be supposedly shifting the focus from individual mods to decision-making skills and judgment, as stated above. However, it's unclear what this actually entails and how it affects the evaluation. Is it an actual different approach in how the modder is evaluated, or does it just mean that the selected maps and the answers will be more important while the mods themselves will be a bit less important than before?
I have a lot of doubts about the questions too because it's not clear how they should be answered. For example, when answering "How did your mod improve this beatmap?", are applicants meant to describe the issues and corresponding suggestions they made and how they would make the map better, are they meant to explain how the map in its current state differs from how it was before the mod, or are they meant to link certain timestamps as examples of things that were fixed (or a combination of these)? The question "Why do you believe this beatmap is ready to be nominated?" is also strange to ask because whether a map is suitable for ranked is usually not determined based on the presence of positive aspects, but rather based on the absence of negative ones. Neither BNs who nominate a map nor evaluators who assess the nominating BNs have to explain why a map is fine to be ranked. Therefore, an answer along the lines of "The map doesn't have problems" would be perfectly reasonable, but I doubt this is the type of answer that is being looked for. What is the expected response to this question though? That the map has good structure, represents the song well, and plays well? These things don't really provide meaningful information for the application. Also, how detailed should these answers be? All of this can be very offputting for those who apply and it could impact their application negatively if questions are misunderstood or they don't know how to reply, even if they are good at modding and judging maps.
achyoo wrote: 2rd30
Goes without saying but please disclaimer to people to not answer "no dont like song" even though that's what all BNs do, since it gives nothing for you to judge.
Or maybe don't, let the people who troll wait 60 days more.
It's not trolling to give a valid reason not to nominate a map, just like "I don't like the map" is a valid reason. This is why the questions' objective should be very clear. If certain answers are not wanted, the questions should be formulated in a way that doesn't allow said answer to be given.
Nao Tomori wrote: 1f93x
We are requesting one map judged as good (but not an overly safe map that has already been bubbled or by an experienced mapper)
This is another example of "hidden expectations" within BN applications that have been a huge problem. There is no mention anywhere that a "safe map by an experienced mapper" is not desired, so expecting people to know this is unfair. Aside from the fact that there is no objective definition of such a map, I also don't get why it would not be appropriate to choose. Sure, if the map is very polished there might not be much to point out, but a good modder still has the possibility to find areas for improvement and mistakes that should be fixed. Also, aren't BNs supposed to nominate high quality maps (which are often created by experienced mappers)? This even shows they are capable of recognizing maps that are better than average.
RandomeLoL wrote: 6j2w4
The goal of the changes wasn't so much as to outright reduce the bar of entry into the BNG, but to make it less obtuse, easier to understand, more transparent to the end , and finally give a sense of direction of what exactly should be prioritized when evaluating someone's work which would affect the way applications are approached from both ends.
Unfortunately I fail to see how these changes concretely achieve these goals or even move closer to them, at least from the perspective of applicants. The transparency improvements are good, but other than that I really don't think this would make things "less obtuse, easier to understand" or give "a sense of direction", it's just slightly different than before but essentially the same process.
RandomeLoL wrote: 6j2w4
s should have a better, more fun time. Submitting mods that they may've done at their own leisure and pace feels to be less restrictive and mentally taxing.
I don't think there's even a single person who is having fun or treating BN apps like a game. Even without the BN test, applicants are preparing for it like an exam and usually getting nervous. Sometimes people might "yolo" apply without caring too much but usually those attempts are not successful, unless they're very experienced.