Home | Sitemap | Contact Us
 
 
Home arrow Trends and Insights arrow ValueNotes Reports arrow Examinations and the role of technology: Emerging Directions  
Sunday, 12 February 2012
Examinations and the role of technology: Emerging Directions

Published March 2010

The report is sent in PDF format and will be e-mailed to you within one working day from the purchase of the report.

The ValueNotes report, `Examinations and the Role of Technology: Emerging Directions’, an initiative by MeritTrac, in collaboration with EDGE forum, is the first of its kind in India. It endeavors to look at the issues with traditional paper-pencil examinations and the potential benefits of leveraging technology to deliver such exams. The report provides insights into the awareness, perception, readiness and experience of key stakeholders in Indian higher education with respect to technology solutions to assessment, primarily online examinations. The study was based on an exhaustive, countrywide survey of more than 75 key decision makers including vice chancellors, exam controllers, university registrars, academic experts, etc.

The study also includes a student perception survey – covering 400 students across several Tier I, II & III cities, to understand how students feel about online exams. The survey indicates that students too are positively inclined towards online examinations, despite concerns being raised by skeptics on their behalf. Interestingly, the supposedly less technology-enabled students in the Tier III cities are the most positive about such exams.

Some interesting insights from the survey of university officials are:

  • 52% of all VCs/Registrars/CoEs interviewed indicated that they are interested in the concept of using technology in exams, 15% are in the experimentation stage and 15% have already begun.
  • 70% of all VCs/Registrars/CoEs indicated that they are considering introducing online examinations and 68% of these respondents indicated that they will do this in the next 6-36 months.
  • Decision makers largely believe that technology solutions can mitigate some of the immense challenges we face and the level of awareness on the potential of technology is quite high.
  • The top three priorities in exam management are faster results, greater transparency, and student authentication/higher security. Respondents said these will have the most impact on their decision to go online.
  • Infrastructure, suitability of the test format and equating between multiple-batches of exams emerged as the top three perceived challenges with almost 60% of the respondents referring to them.
  • Some respondents were also worried about the students from rural areas, who may not have access to computers at all, and may face difficulty in adopting this.

On the perceptions of the students:

  • An overwhelming majority of students (95%) are aware of online assessments, and this is consistent even in Tier III cities.
  • The majority of students (69%) felt that universities that conduct online exams are more technically advanced – especially students originating from Tier III cities.
  • Majority of students consider the online process to be more accurate and secure, compared to traditional methods.
  • Transparency of processes and convenience are the main perceived benefits,  though students are concerned about the difficulty of usage of online exams, and lack of support from exam authorities. 

Despite the recent issues in online testing, universities still believe in the positive impact of technology, though they are more concerned about the implementation.  Considering there is still a lot of groundwork to be done, the penetration of online exams will increase by 5 -10% in the next two years. However, given the greater levels of experimentation and innovation in the assessment space, we believe that there will be significant traction over the next three to five years,” feels Mr Arun Jethmalani, Managing Director, ValueNotes.

To download the executive summary of the report, click here . If you would like a free copy of the report, please write in to us at  This e-mail address is being protected from spam bots, you need JavaScript enabled to view it or contact us at +91 20 6623 1783.


Table of Contents (Pages 83)
 
1.Indian Higher Education: Need for Exam Reforms

2.Summary Findings
2.1 Growing global higher education exam market faces many challenges
2.2 Online assessment has manifold benefits and addresses many challenges
2.3 Indian Higher Education: On road to change and a long way to go
2.4 Technology in exams: The Indian higher education context
2.4.1 Many potential rewards for Indian educational institutions
2.4.2 Infrastructure the main challenge for Indian higher education
2.4.3 Online exams in India - Future plans
2.4.4 The opportunity is huge
2.5 Indian students ready for online exams
2.5.1 High awareness and readiness but low experience with online exams
2.5.2 Perceived / expected benefits and issues
2.6 Conclusion

3.Importance of Assessment in Exam Management
3.1 Introduction
3.2 Typical exam process
3.3 Importance of measuring outcomes
3.4 Types of exams and assessment tools
3.5 Trends and innovations in university assessment
4.Global Trends in Online Assessment
4.1 Online assessment: Increasing scope
4.2 Online assessment: Increasing acceptance
4.3 Use of technology in assessment set to grow further
4.4 Diverse applications of online assessment
4.5 Customized as per regional needs
4.6 Examples of online exams
4.6.1 Utah Education Network
4.6.2 Graduate Record Examinations (GRE)
4.6.3 Test of English as a Foreign Language (TOEFL)
4.6.4 Graduate Management Admission Test (GMAT)
 5.Indian Higher Education: An Overview
5.1 Indian higher education: A snapshot
5.1.1 Budget allocation and plans – Big but inadequate
5.1.2 A huge demand-supply gap
5.1.3 Higher education: Quality issues
5.2 Going forward: Indian education needs quantity and quality
5.2.1 Driving changes at the policy level
5.2.1.1New bills and regulations
5.2.1.2Increasing competition
5.2.1.3Need for consistency and deregulation
5.2.2 Demand will drive growth
5.2.2.1Rising middle class driving demand
5.2.2.2Interest in the sector rising
5.2.3 Gender parity and greater awareness drives growth
5.3 Indian higher education: long way to go
5.3.1 Planning and policy makeover
5.3.2 Higher education needs the ICT push
5.3.3 Survival of the best
5.4 The Indian exam market
5.5 Challenges in traditional exam management
5.5.1 Administrative challenges
5.5.2 Exam design challenges
5.5.3 Resource allocation challenges
5.6 Tackling exam challenges through technology
5.6.1 Increase in experiments to increase assessment effectiveness
Gujarat Technological University takes entrance exams online
5.6.2 Managing with less resources
Case study: NMIMS move to online exam
5.6.3 Rising importance to security and controlling malpractices
Case study: Manipal University - One of the front-runners in online exams
Case study: University of Pune looking for better practices
6.Technology in Indian Higher Education Exams
6.1 Online examination: Intent
6.1.1 High interest in conducting exams online
6.1.2 Future plans
6.1.3 Lack of clarity
6.2 Online exams: perceived benefits
6.2.1 Benefits: Lower costs
6.2.2 Benefits: Increase in reach
6.3 Online exams – Key concerns
6.3.1 State-of-the-art infrastructure
6.3.2 Resistance to change
6.3.3 Adaptation of exam format
6.3.4 Unsure about the value of investment
6.4 Online exams: Execution
6.4.1 Execution: Automated administrative tasks
6.4.2 Execution: Establish an efficient system
6.4.3 Execution: Establish a credible system
6.4.4 Execution: User friendly systems
6.5 Conclusion

 7.Student Speak
7.1 Profile of respondents
7.1.1 General information
7.1.2 Ownership of technology
7.1.3 Academic use of technology
7.2 Awareness and experience with online exams
7.2.1 Most students are aware of online exams
7.2.2 Majority of students have no experience with online exams
7.3 Readiness towards online exams
7.3.1 Conducting online exams sends positive messages to students
7.3.2 Online exams score high on security and credibility
7.3.3 Students feel online exams are far more accurate
7.3.4 Students have preferences in type of exam to take online
7.3.5 Students more likely to join a university which conducts online exams
7.4 Perceived benefits and key concerns
7.4.1 Students see many important benefits of online exams
7.4.2 Support and difficulty of usage the key concerns
7.5 Conclusion

 8.Conclusion
 9.About ValueNotes
 10.About EDGE Forum
 11.About MeritTrac
 12.About Excelsoft

Table of Exhibits
 
Exhibit 1: Challenges in university exam management
Exhibit 2: Megatrends in higher education and their impact on assessment
Exhibit 3: Online examinations – many potential rewards
Exhibit 4: Challenges to online exams
Exhibit 5: Are online exams a part of Indian higher education's plan?
Exhibit 6: Perceived / expected benefits of online exams
Exhibit 7: Perceived / expected issues with online exams
Exhibit 8: Typical exam process
Exhibit 9: Interrelatedness of assessments to course curriculum objectives
Exhibit 10: Types of assessment tools
Exhibit 11: Megatrends in higher education and their impact on assessment
Exhibit 12: Online assessment process
Exhibit 13: Online assessment – Questions and tasks
Exhibit 14: Structure and size– Indian higher education
Exhibit 15: Budget allocation for higher education
Exhibit 16: Comparative Gross Enrollment Ratio
Exhibit 17: Market size of Indian higher education exam market
Exhibit 18: Challenges in university exam management
Exhibit 19: Interest levels in online exams are high
Exhibit 20: Moving towards online exams?
Exhibit 21: Lack of clarity on implementation time frame
Exhibit 22: Online examinations – many potential rewards
Exhibit 23: Infrastructure a major impediment to online exams
Exhibit 24: Major reluctance to increasing budgets for online exams
Exhibit 25: Reluctance to increase exam fees for introducing online exams
Exhibit 26: Increasing use of technology in exam process
Exhibit 27: Preference of time frame for multiple batches
Exhibit 28: Age brackets and gender distribution of respondents
Exhibit 29: Distribution of respondents' academic level and city of study
Exhibit 30: Distribution of respondents' stream of study
Exhibit 31: Ownership of computer/laptop and Internet connection
Exhibit 32: High frequency of usage of technology
Exhibit 33: Similar academic use of technology across city tiers
Exhibit 34: Most students are aware of online exams
Exhibit 35: Students originating from Tier III cities are less aware of online exams
Exhibit 36: Students who are not aware of online exams do not possess an Internet connection
Exhibit 37: Majority of students have no experience with online exams
Exhibit 38: Tier I students have more experience with online exams
Exhibit 39: Conducting online exams sends positive messages to students
Exhibit 40: Students originating from Tier III cities far more impressed with online exams
Exhibit 41: Online exams score high on security and credibility
Exhibit 42: Experienced students perceive no difference in security
Exhibit 43: Students feel online exams are far more accurate
Exhibit 44: Speculation among students who haven't given online exams
Exhibit 45: Students who feel accuracy is higher are more likely to join a university which conducts online exams
Exhibit 46: Students have preferences in type of exam to take online
Exhibit 47: Students more likely to join a university which conducts online exams
Exhibit 48: Perceived / expected benefits of online exams
Exhibit 49: Perceived / expected issues with online exams
Annexure 1: List of participating universities and exam boards
Annexure 2: Delivering online exams consistently
Annexure 3: CAT in mousetrap: A failure of management, says expert

If you cannot find what you are looking for, please get in touch with us at This e-mail address is being protected from spam bots, you need JavaScript enabled to view it

 
< Prev   Next >
Latest from our blog
The State of Sourcing

Join forum
LegalConnect
PublishingConnect
My Shopping Cart
 
Latest Publications
The Pharmaceutical Industry Sourcing Landscape in 2011
 
The utilities sourcing landscape in 2011: Are global utilities outsourcing smarter?
 
Subscribe Newsletter
Name:
Email: