{"id":105,"date":"2021-11-29T17:05:47","date_gmt":"2021-11-29T17:05:47","guid":{"rendered":"http:\/\/192.168.64.4\/in-en\/?post_type=ai&p=105"},"modified":"2023-06-12T10:21:53","modified_gmt":"2023-06-12T10:21:53","slug":"solver-technology-to-automatically-answer-questions","status":"publish","type":"ai","link":"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/","title":{"rendered":"Solver Technology to Automatically Answer Questions"},"content":{"rendered":"

As an EdTech platform, allowing students to practice questions on thousands of concepts from the syllabi of hundreds of exams through solver technology is a must. Embibe has invested in enriching questions with explanations and step-by-step solution guides to help students understand how a particular question can be solved. This has been a manual process wherein human subject matter experts solve the questions. <\/span><\/p>\n

As Embibe\u2019s question dataset grows, relying on manually created solutions is prohibitively expensive. Solver Technology is still a relatively nascent field which has seen some success in generating algorithms to solve text questions in certain specific domains like intermediate-level mathematics. <\/span><\/p>\n

Embibe is pursuing research in this area to be able to automatically generate answers and step-by-step solutions for the vast number of questions.<\/span><\/p>\n

Problem Statement<\/b><\/h3>\n

Given a text question in Maths, solve it using solver tech codes and provide a step-by-step solution.<\/span><\/p>\n

The question can be any freeform question from the student, not necessarily in a particular format. We try to solve it and provide the solution steps.<\/span>
\n<\/span><\/p>\n

Approach<\/b><\/h3>\n

Here\u2019s what the whole process looks like:<\/span><\/p>\n

\"\"<\/p>\n

For example,<\/span><\/p>\n

Here\u2019s a question from the 6th CBSE:<\/span><\/p>\n

\u201cWrite in figures – Two lahk fifty thousand nine hundred thirty-six.\u201d<\/strong><\/p>\n

So, in the first stage, we try to predict the solver code to solve this question, which is \u201c<\/strong><\/span>convert_text_to_number<\/strong>\u201d<\/strong>.<\/span><\/p>\n

In the next stage, we fetch the argument for the predicted solver to evaluate it. So, in this case, the input argument to the solver will be <\/span>\u201ctwo lakh fifty thousand nine hundred thirty-six\u201d<\/b>.<\/span><\/p>\n

So, we get the full solver:<\/span><\/p>\n

convert_text_to_number(two lakh fifty thousand nine hundred thirty-six)<\/strong>.<\/span><\/p>\n

Then we evaluate the solver with the argument to get the answer and step-by-step solution, which looks like this:<\/span><\/p>\n

\"\"<\/p>\n

Let\u2019s elaborate with another example question:<\/span><\/p>\n

\u201cMrs Soni bought 7 1\/2 litres of milk. Out of this milk, 5 3\/4 litres was consumed. How much milk is left with her?\u201d<\/strong><\/p>\n

This can be solved using the \u201c<\/strong><\/span>subtract_fractions_mixed_type(7 1\/2, 5 3\/4)\u201d<\/strong> solver code.<\/span><\/p>\n

We will get the solution steps like this.<\/span><\/p>\n

\"\"<\/p>\n

Solution<\/b><\/h3>\n

We can divide the solution into two steps.<\/span><\/p>\n

    \n
  1. Solver code prediction<\/span><\/li>\n
  2. Argument Extraction<\/span><\/li>\n<\/ol>\n

    In solver code prediction, we try to predict the solver codes using which given math problems can be solved. For instance, in the above example, \u201c<\/strong><\/span>subtract_fractions_mixed_type<\/strong>\u201d<\/strong> was the correct solver for solving the given problem. We can use deep learning generative seq2seq models like T5[1] to generate the solver code to solve the problem.<\/span><\/p>\n

    Before moving to the second step, we need 1 sample solver with arguments for each solver code. For example, a sample solver for \u201c<\/strong><\/span>subtract_fractions_mixed_type<\/strong>\u201d<\/strong> can be something like \u201c<\/strong><\/span>subtract_fractions_mixed_type(1 2\/3, 4 5\/6)<\/strong>\u201d<\/strong>. How this will be useful, we will explore soon.<\/span><\/p>\n

    Once we get the predicted solver technology code for solving the given problem, we need to fetch the arguments from the question. We can also use generative seq2seq models like T5[1]. Such language models are further extended with knowledge infusion architecture to leverage the semantic relationships captured in the knowledge graphs [3][4]. We can give the problem statement and the sample solver for the predicted solver. And we will get the solver code with actual arguments from the questions from the T5[1] model. So, we will have the solver code with arguments, i.e., <\/span>\u201csubtract_fractions_mixed_type(7 1\/2, 5 3\/4)\u201d<\/b> from the above example.<\/span><\/p>\n

    We can also use other relatively simple methods to fetch the arguments from the question. If we have the data types and samples of the arguments for each solver, which we have in our case, we can try to fetch similar numbers from the question.<\/span><\/p>\n

    This is how we will predict the solver code and fetch the solver arguments from the question. Once we get both of them, we just need to evaluate the solver code to get the correct answer and step-by-step solution.<\/span><\/p>\n

    References<\/b><\/p>\n

    [1] Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu.<\/span> \u201cExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer\u201d<\/span><\/a><\/p>\n

    [2] <\/span>Amini, Aida, Saadia Gabriel, Peter Lin, Rik Koncel-Kedziorski, Yejin Choi, and Hannaneh Hajishirzi. <\/span>“MathQA: Towards interpretable math word problem solving with operation-based formalisms.”<\/span><\/a> arXiv preprint arXiv:1905.13319<\/span><\/i> (2019).<\/span><\/p>\n

    [3] <\/span>Faldu, Keyur, Amit Sheth, Prashant Kikani, and Hemang Akabari. “KI-BERT: Infusing Knowledge Context for Better Language and Domain Understanding.” arXiv preprint arXiv:2104.08145 (2021).<\/span><\/p>\n

    [4] Gaur, Manas, Keyur Faldu, and Amit Sheth. “Semantics of the Black-Box: Can knowledge graphs help make deep learning systems more interpretable and explainable?.” IEEE Internet Computing 25, no. 1 (2021): 51-59.<\/span><\/p>\n","protected":false},"featured_media":0,"template":"","yoast_head":"\nAutomated Question Answering with Solver Technology at Embibe<\/title>\n<meta name=\"description\" content=\"Learn how Embibe uses solver technology to create step-wise solutions for text questions in math & other subjects. Discover Embibe's holistic approach to enhance learning experience.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Automated Question Answering with Solver Technology at Embibe\" \/>\n<meta property=\"og:description\" content=\"Learn how Embibe uses solver technology to create step-wise solutions for text questions in math & other subjects. Discover Embibe's holistic approach to enhance learning experience.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/\" \/>\n<meta property=\"og:site_name\" content=\"EMBIBE - The most powerful AI-powered learning platform\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-12T10:21:53+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/exams-assets.embibe.com\/exams\/wp-content\/uploads\/2021\/11\/03002516\/ai7.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/\",\"url\":\"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/\",\"name\":\"Automated Question Answering with Solver Technology at Embibe\",\"isPartOf\":{\"@id\":\"https:\/\/www.embibe.com\/in-en\/#website\"},\"datePublished\":\"2021-11-29T17:05:47+00:00\",\"dateModified\":\"2023-06-12T10:21:53+00:00\",\"description\":\"Learn how Embibe uses solver technology to create step-wise solutions for text questions in math & other subjects. Discover Embibe's holistic approach to enhance learning experience.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.embibe.com\/in-en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Solver Technology to Automatically Answer Questions\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.embibe.com\/in-en\/#website\",\"url\":\"https:\/\/www.embibe.com\/in-en\/\",\"name\":\"EMBIBE - The most powerful AI-powered learning platform\",\"description\":\"Just another WordPress site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.embibe.com\/in-en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Automated Question Answering with Solver Technology at Embibe","description":"Learn how Embibe uses solver technology to create step-wise solutions for text questions in math & other subjects. Discover Embibe's holistic approach to enhance learning experience.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/","og_locale":"en_US","og_type":"article","og_title":"Automated Question Answering with Solver Technology at Embibe","og_description":"Learn how Embibe uses solver technology to create step-wise solutions for text questions in math & other subjects. Discover Embibe's holistic approach to enhance learning experience.","og_url":"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/","og_site_name":"EMBIBE - The most powerful AI-powered learning platform","article_modified_time":"2023-06-12T10:21:53+00:00","og_image":[{"url":"https:\/\/exams-assets.embibe.com\/exams\/wp-content\/uploads\/2021\/11\/03002516\/ai7.png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/","url":"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/","name":"Automated Question Answering with Solver Technology at Embibe","isPartOf":{"@id":"https:\/\/www.embibe.com\/in-en\/#website"},"datePublished":"2021-11-29T17:05:47+00:00","dateModified":"2023-06-12T10:21:53+00:00","description":"Learn how Embibe uses solver technology to create step-wise solutions for text questions in math & other subjects. Discover Embibe's holistic approach to enhance learning experience.","breadcrumb":{"@id":"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.embibe.com\/in-en\/artificial-intelligence-ai-in-education\/solver-technology-to-automatically-answer-questions\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.embibe.com\/in-en\/"},{"@type":"ListItem","position":2,"name":"Solver Technology to Automatically Answer Questions"}]},{"@type":"WebSite","@id":"https:\/\/www.embibe.com\/in-en\/#website","url":"https:\/\/www.embibe.com\/in-en\/","name":"EMBIBE - The most powerful AI-powered learning platform","description":"Just another WordPress site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.embibe.com\/in-en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/www.embibe.com\/in-en\/wp-json\/wp\/v2\/ai\/105"}],"collection":[{"href":"https:\/\/www.embibe.com\/in-en\/wp-json\/wp\/v2\/ai"}],"about":[{"href":"https:\/\/www.embibe.com\/in-en\/wp-json\/wp\/v2\/types\/ai"}],"wp:attachment":[{"href":"https:\/\/www.embibe.com\/in-en\/wp-json\/wp\/v2\/media?parent=105"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}