Report/Questionnaire
This question is in the form of a free-writing response to a question text.
Required
Management role of Content manager (Edit)
Creating an Issue
01.Open the question edit screen
In the "Quiz/Test Creation Form," click "Edit Question" for each question.
02.Selection of question format
In the "Questionnaire Format" pull-down menu, select "Report/Survey Writing.
03. Problem Creation
The following input form will expand.
For each item, please set each of the following.
Question sentences
Enter a question text for the assignment.
supplementary explanation
Enter if you need additional explanation for the question.
description method
Please select from the following four methods.
text entry
This is a method of entering text.
Text Entry & File Submission
In addition to text input, this method uploads files.
Please select the maximum capacity and file format you are allowed to submit.
Handwriting with pen
This is a method of handwriting by tracing on the screen.
Select the size of the frame where the handwriting will be done.
④Voice recording
This method is to record your voice directly and submit it.
Enter the maximum recording time.
input character limit
This setting is available when "Text Input" or "Text Input & File Submission" is selected for "Description Method.
*The number of input characters can be set from 1 to 10,000.
However, if AI report analysis/AI scoring is used, it can be set from 1 to 3,000 characters.
Grading
Please select from the following four methods.
1. Manual
The administrator will manually grade, pass/fail, and return reports.
2. Manula & AI report analysis
AI report analysis assists managers with manual scoring.
3. AI
AI will automatically grade, pass/fail, and return reports.
(iv) Assign a score if there is a description.
If there is any kind of description, it will automatically assign a score for the distribution of points.
Up to 5 questions using AI report analysis and AI scoring can be created for each quiz/test.
Depending on what you select, the items to set will be different.
*For more details, refer to the following table.
| Grading | Evaluation method | Setting items |
|---|---|---|
| Manual | ・ Note to admin | |
| Manual & AI report analysis | Degree of similarity to model answers | AI Report Analysis Settings Report Analysis Settings ・ Note to admin |
| Rubrics | AI Report Analysis Settings ・Rubrics | |
| AI-assisted grading | Degree of similarity to model answers | AI Report Analysis Settings Report Analysis Settings |
| Rubrics | AI Report Analysis Settings ・Rubrics | |
| Assign a score if there is a description | Use the number of words as the criterion for the score. |
AI Report Analysis Settings
▼ Languages to be used
Select the language you wish to use from "Japanese/English/Vietnamese".
▼ Analysis at Reception
If you tick the "Analyze automatically on submission" box, AI report analysis will be performed as soon as the user submits the report. When un-ticked, AI report analysis will be performed after the "Report Analysis" button is clicked on the "Grading" screen of the grade management.
*Displayed when "Scoring by Administrator + AI Report Analysis" is selected in "Scoring Method".
▼ Custom prompt
You can enter supplementary information to help AI analyze your submission more accurately.
*Displayed when "Rubric Evaluation" is selected under "Evaluation Method".
Custom prompts help the AI generate feedback tailored to your specific goals.
*For more details, refer to Custom prompt.
Report Analysis Settings
Model answers are created in advance, and AI analysis determines the degree of similarity.
Please enter your model answer in the input field.
Clicking on "Open Report Analysis Preview" will expand the following contents.
Enter the submission preview and click on the blue button.
Rubrics
What is Rubric Evaluation?
This method measures the level of achievement by arranging the evaluation perspectives (rubrics).
e.g.)
First, we will explain how to create it manually.
Please set up the following items to be used in the rubric evaluation.
▼Evaluation Perspectives
Enter a title of rubric. (max. 60 characters)
*You cannot use the same title.
▼Trigger
Enter a description.
▼Evaluation Level
Set the following items.
1. Score: Enter the score for each criteria (0 to 100).
2. Level of achievement: Enter the level of achievement. (max 20 characters)
3. Assessment criteria: Enter the assessment criteria for each. (max 200 characters)
4.︙: You can duplicate/delete each criteria.
5. +Add: You can add levels of achievement (between 2 and 5).
Scores, level of achievement and assessment criteria cannot be the same within the same rubric.
▼︙ (Edit Perspective menu)
Click "︙" in the upper right corner of each criteria to display the following menu.
・Duplicate: Criteria can be duplicated.
・Move up: Criteria can be moved up one level.
・Move Down: Criteria can be moved down one level.
・Delete: Criteria can be deleted.
▼+Additional evaluation perspectives
More criteria can be added (up to 10).
Auto generation by AI
When you click "Generate Rubric with AI," the following pop-up will appear.
Set the rubric theme, number of rubrics and nuber of levels of achievement.
Click "Generate".
Based on the settings, AI automatically generates rubrics.
*Please enter the theme of the rubric in 2000 characters or less.
To use this auto generation of rubrics by AI, Standard or above plan is required.
User interface
Learners can view the results of the rubrics on the Answer details page.
Within each question, the evaluation criteria/scores/levels and feedback for each perspective are displayed.
Use the number of characters as the criterion for the score.
Please tick the box "Use the number of letters as the basis for the score."
Scoring criteria can be added with "+ Add Setting" and deleted with the O button (up to 10 settings).
*This can be set when "Scoring Method" is selected as "Assign points if description is available".
Note to admin
Please enter any information you would like to share with the scorer.
explanation
After the learner's answer, an explanation for the question can be displayed.
If used, please enter the information to be displayed.
Score Allocation
If you use rubric evaluation, you will need to establish a point distribution.
In addition, the total of the highest score and the distribution of points for each point of view should be set to be the same.
You can check how it looks on the study screen from the "Preview" menu.
When you have completed the settings, click on "Return to List.
Grading of questions
The submitted data will be graded in the Grading statusThis will be done from
01. Go to Grading status
In the side menu, select "Grading and Analysis" > "Scoring Management".
02. Confirm submitted file
Click on the target content in the list displayed on the "Scoring Management" screen.
When the Submission List page appears, click on "Details" for the grade in question.
03. Grading
The grade details screen will appear.
Click on the "Score" button to score the submitted data.
*For more details, refer to Grading.
