Can't use Slack Group and Problem about evaluation - Biendata

^En/_中
Host a Competition
Login
Sign Up

Login
Sign Up

Discussion

Home Discussion Board 2020 ICDM Knowledge Graph Contest : Specification Can't use Slack Group and Problem about evaluation

Runa

Can't use Slack Group and Problem about evaluation

posted in 2020 ICDM Knowledge Graph Contest : Specification

2020-07-14 06:15

23 comments

songyh

2020-07-14 09:05

Reply

0

Runa reply songyh

2020-07-14 11:10

The comment has been deleted by author.

Runa reply songyh

2020-07-14 11:13

Reply

0

<p>1.【The reason should match first.】 Does this mean that the [start] of text in reason is the most important？In the previous reading comprehension tasks with classification, the result category is often one of the keys to scoring, so I want to know the specific scoring rules for each reason about start, text, and type. Can you provide a specific evaluation method?</p> <ol> <li>My email: <a href="mailto:qiusy@deepblueai.com">qiusy@deepblueai.com</a>, and my teammate <a href="mailto:panchg@deepblueai.com.">panchg@deepblueai.com.</a><br>Thank you!</li></ol>

songyh reply Runa

2020-07-15 02:26

Reply

0

<p>【I want to know the specific scoring rules for each reason about start, text, and type.】<br>1.Type：the type should match first.If the type is wrong，you will get no score.<br>2.text: the text(or reason in this task) in your submission will be compared with our labeled text by each word.For example your submission contains 20 words and the answer has 10 words, the correct words is 5:<br>pre = 5/20 =0.25<br>rec = 5/10 =0.5<br>f1_score = 2prerec/(pre+rec)=0.3333<br>3.start: the start is also considered as one word, it’s not so important.<br>And I have invited you two in the Slack group，can you see now？</p>

/

/

/