知识问答有多智能？一份符号逻辑评测集考考你

{"type":"doc","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"导语"},{"type":"text","text":" | 随着知识问答在行业不同垂直领域的发展，知识问答的能力也在不断的提高和升级，本着Nlper的初心和AI评测的态度，我们为知识问答设计了一份考题（评测集），让我们一起来看看在这份考题下，当前的知识问答能考多少分呢？文章作者：周磊，腾讯CSIG质量部评测研究员"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"一、背景"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"知识问答（KBQA）通常是指结合了自然语言理解，知识图谱，自然语言生成等技术的问答系统。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"知识问答在行业中的应用是非常广的，目前涉及到百科知识类的问答基本上都是靠KBQA赋能。比如智能音箱，需要支持一些人物等百科类的问答；景区实体机器人，需要支持景点的一些景观问答和历史问答；包括外卖，电商应用上的一些逻辑复杂的查询，这些都是知识问答在具体应用上的落地。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"知识问答已经发展了很多年了，从最早期基于模版，基于社区，直到基于知识图谱。知识图谱赋予了知识问答很强的解释性和问题的表示能力，但知识问答跟自然语言理解这个大主题一样，其能力本身还是一个很低年级的水平。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"二、业界评测集"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"伴随着KBQA的发展，业界评测集的难度也在慢慢转变。从早期最简单的单跳问答，到多跳到更复杂的问题慢慢发展。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"其中WebQuestions相对简单，基本上都是一些简单的问法。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}}]}