|Year : 2014 | Volume
| Issue : 3 | Page : 243-251
How knowledgeable are investigators studying therapies of traditional medicines?
Saravu R Narahari1, Madhur G Aggithaya1, Chendalam Thamban2, Kunnathody Muralidharan2, Aniruddha B Kanjarpane1
1 Institute of Applied Dermatology, Kasaragod, India
2 Social Science division, Central Plantation Crops Research Institute, Kudlu, Kasaragod, Kerala, India
|Date of Web Publication||20-Mar-2015|
Saravu R Narahari
Director, Institute of Applied Dermatology, IAD Junction, Uliyathadka, Madhur Road, Kasaragod - 671 124, Kerala
Source of Support: National Science and Technology Management
Information System (NSTMIS), Department of Science and Technology,
Government of India, Conflict of Interest: None
| Abstract|| |
Context: Research methodology in traditional Indian system of medicine. Aim: To determine the knowledge level of investigators conducting clinical trials in traditional medicines (TMs) including Ayurveda. Materials and Methods: This was a questionnaire survey conducted for selected researchers trained in any specialty and working in TM. 2087 researchers were selected based on selection criteria. A validated and pretested questionnaire containing the questions regarding regulatory issues, literature search, evidence-based medicine, clinical trial design, patient selection, and study reporting were sent either through E-mail or post. The answered questionnaires were analyzed. The parameters were analyzed based on median and interquartile range (IQR). Results: Forty two responses were received through E-mail and 21 researchers responded through post. Out of 63, six researchers sent incomplete responses. Among the remaining 57 respondents; 34 (59.6%) investigators had postdoctoral degree, 43 investigators (75.4%) did not receive any structured training on research methodology, 23 (40.4%) had two decades of research experience. Thirty three (74%) of investigators who received government funding didn't have any training on research methodology. Ayurveda experts group had better knowledge compared to pharmaceutical sciences and basic science group although they had a dilemma about conducting clinical evaluation of TM within the specific framework of rigorous clinical pharmacological principles without ignoring the Ayurvedic concepts such as Dosha, Prakruti etc., Investigators below 30 years possessed higher knowledge of research methodology when analyzed based on the age. The respondents working in research organizations, government organizations, and academic institutions had lower knowledge compared to those who were in private organizations/practice. Conclusions: It is recommend that investigators, peer reviewers, and fund managers involved in traditional medicine research need training especially in research methodology.
Keywords: Ayurveda, evidence-based medicine, Integrative Medicine, knowledge level analysis, research design, research funding agencies, research policy, training support
|How to cite this article:|
Narahari SR, Aggithaya MG, Thamban C, Muralidharan K, Kanjarpane AB. How knowledgeable are investigators studying therapies of traditional medicines?. AYU 2014;35:243-51
|How to cite this URL:|
Narahari SR, Aggithaya MG, Thamban C, Muralidharan K, Kanjarpane AB. How knowledgeable are investigators studying therapies of traditional medicines?. AYU [serial online] 2014 [cited 2022 Oct 1];35:243-51. Available from: https://www.ayujournal.org/text.asp?2014/35/3/243/153734
| Introduction|| |
Traditional medicines (TMs), including Ayurveda, have not been officially recognized in many countries due to the lack of research evidence.  Some of the challenges on working in these nonbiomedical systems are the patient selection, regulatory issues, quality, and purity of the medicines.  A systematic search on vitiligo  for research papers and thesis on Ayurveda topics showed heterogeneous studies deficient in many basic issues concerning clinical trials. In this background, a study has been conducted to determine the knowledge level of investigators on conducting clinical trials in Ayurveda.
| Methods|| |
The study was conducted during 2010-2011, among researchers trained in any specialty and selected on the basis of their participation in TM research. A list of E-mails and postal address of investigators (authors and subscribers) were obtained from Indian journal editors publishing on TM, E-mail forums and websites of Indian health research grant making agencies. A total of 2087 researchers were thus listed initially for inclusion in the study and were contacted for a response through E-mail (1631 nos.) and by post (456) along with self-addressed envelope. The nonrespondents were reminded after 1 month. However, 336 (20.6%) mail IDs bounced back stating incorrect mail address, and only 42 responses were received through E-mail. Similarly, 10 (2.2%) researchers could not be contacted since the letters were returned by post stating incorrect address and only 21 researchers responded through post. Thus, the total number of researchers who could be included in the study was 63. Again, out of the total of 63 researchers included in the study, six researchers sent incomplete responses. Hence, the final number of respondents in the study was only 57 [Figure 1].
|Figure 1: Flow chart showing the selection of researchers in different levels of inclusion|
Click here to view
Tools of data collection
Data was collected from the respondents using a pretested questionnaire [Annexure - 1 [Additional file 1] ]. The questionnaire inquired on regulatory issues to conduct clinical studies, literature search, concepts of evidence-based medicine, clinical trial design, patient selection in TMs, and study reporting. The information such as age, educational qualification, occupation, and research experiences were included in general information section. Questionnaire consisted of three sections to assess the knowledge level of researchers in TM. It contained closed- and open-ended questions. First section had 15 open ended questions, asking the opinion about principles of patient treatment in Ayurveda. Second section contained multiple choice questions about current methods of evidence-based research, with the right answer and three wrong answers. The option "don't know" was also added. There were 20 closed type questions on research methodology. The publication on evidence-based approaches for Ayurveda was used as standard.  Prepared questionnaire were edited by four referees comprising an allopathic researcher working in Ayurveda, two Ayurvedic academicians and, a questionnaire expert. The edited questionnaire were pretested on 57 postgraduate students and nine undergraduate teachers in two Ayurvedic Medical Colleges.
Analysis of data
The parameters were analyzed based on median and interquartile range (IQR). All the data were analyzed through SPSS 16 (SPSS Inc., Chicago, IL, USA).
| Results|| |
Profile characteristics of researchers
Among 57 respondents, 23 (40.4%) had >21 years and 15 (26.3%) <7 years of experience in their specialty. 45 (78.9%) were currently undertaking a research program. 4 (7%) were in private practice, 23 (40.4%) in research organization, and 17 (29.8%) working in academic institutions. Among the respondents, 27 (73%) were second degree holders in Ayurveda. 34 (59.6%) investigators had postdoctoral degree. All have conducted clinical studies in the past. [Table 1] shows the basic details of the investigators. [Table 2] shows their sources of funding.
Training in research methodology
Among 43 investigators (75.4%) who had not received any structured training on research methodology, 27 (73%) were Ayurvedic doctors. 14 (24.6%) investigators received research methodology training from leading institutions of India like South Asian Cochrane Network and Department of Biostatistics, Christian Medical College located in Vellore, Indian Council for Medical Research in Delhi, Tata Institute of Social Sciences in Mumbai, Central Council for Research in Ayurvedic Sciences in Delhi, KEM Hospital in Mumbai, and Institute of Clinical Research (India). One among two researchers from biomedicine had official training in research methods whereas 6 (54.5%) from basic science, 2 (66.7%) respondents from pharmaceutical science, all respondents from Unani and veterinary medicine did not receive any research methodology training.
Perception about clinical trials
Thirteen respondents opined that clinical trials on Ayurvedic medicine should be done based on Ayurvedic diagnosis. Ten respondents' preferred biomedical diagnosis and 26 felt both diagnostic criteria are essential for conducting Ayurvedic clinical trials. Fifty respondents perceived that the modern laboratory investigations could help in disease diagnosis and assessment of results in Ayurveda and two respondents disagreed.
Knowledge on research methodology
Knowledge level of researchers on research methodologies is summarized in [Table 3].
|Table 3: Knowledge level of researchers on clinical research methodology |
Click here to view
[Figure 2] shows the differences in knowledge level of respondents based on their expertise. Ayurveda experts showed median score 10 with an interquartile range (IQR) range of 9-14. Biomedicine and Unani experts had no IQR and median score was 17 and 13, respectively. Pharmaceutical science experts had median score 9 with an IQR range of 6-12.5. Basic sciences investigators had median score 4 with an IQR range of 4-11.5, whereas Veterinary experts had a median score 4 with an IQR range of 2-5. Analysis of variance test reveals that the mean score of all groups is significant at 5% level (P = 0.016).
|Figure 2: Knowledge level on research methodology according to specialization/qualification/category of researchers|
Click here to view
[Figure 3] shows the differences in knowledge level of respondents based on the age. Respondents below 30 years had 13.5 median score with an IQR range of 11-15.25. Age group of 31-40 years had 10 median score with an IQR range of 7.75-14.25. Respondents who were in private practice, Government Organization and Research Organization had 10 median score with an IQR range of 9-12 in Private practice group, 6-12 in Government Organization group and 4-13 in Research Organization group. Respondents working in private hospital and Academic Institution had 9 median score with an IQR range of 8-13 [Figure 4].
| Discussion|| |
This study determined the knowledge level of investigators conducting clinical trials in Ayurveda. Evidence-based approach for the Ayurvedic traditional herbal formulations was used as standard.  Ayurveda experts group had higher knowledge level compared to pharmaceutical sciences, basic sciences and veterinary sciences groups, with a median score 10 and IQR range of 9-14 [Figure 2]. Knowledge level analysis included queries on regulatory issues, literature search, evidence-based medicine, clinical trial design, patient selection and study reporting. 23 (40.4%) respondents were >21 years of professional experience and 45 (78.9%) had ongoing research projects. Investigators below 30 years possessed higher knowledge level [Figure 3]. The respondents working in research organizations, Government Organization and academic institutions had lower IQR compared to those who were in private practice [Figure 4].
The target population for the study was the researchers investigating TM. The questionnaire was designed as "user friendly" as possible and allowed maximum involvement of the respondents to answer the questions. Pretest showed that participants required 45 min to complete all the three sections, and respondents were able to answer easily. Prepared questionnaire was fine-tuned by experts and pretested using a representative population. This improved the clarity of the questions and avoided ambiguity posed to target population. The questionnaire was sent through mail as well as by post with self-addressed envelope. A covering letter was attached to allow the researcher to understand the objectives of the study.
According to a Gazette notification of Government of India any organization conducting a clinical trial should have an ethics committee registered with drugs controller general of India.  Indian Council for Medical Research has issued ethical guidelines  for studies involving human subjects. The research involving human participants required autonomy or respect for participant, beneficence, nonmalfeasance and justice. The ethics committee has to approve the clinical trial prior to patient recruitment. The questions on regulatory issues covered all these areas. 49 (86%) knew about informed consent and 32 (56.1%) had the knowledge about causality analysis. 34 (59.6%) respondents knew about Clinical Trial Registry of India (CTRI) [Table 3]. It is mandatory to register clinical trials before recruitment of patients. Previous study showed that, out of 588 clinical trials registered in CTRI, 3.57% trials were investigating Ayurvedic medicines.  We searched CTRI using keyword "Ayurveda" and found 102 (2.86%) trials out of 3567 registered trials.
Constructing a well-built research question is an important step to conduct trials  and systematic reviews.  Forty seven (82.5%) of respondents were aware of developing a clinical question as the first step before conducting a clinical trial, but only 8 (14%) had knowledge on building a structured clinical question based on patient, intervention, comparison and outcome  [Table 3]. This indicated the inexplicit research planning in TM.
There are no comprehensive electronic databases similar to PubMed, for Ayurvedic publications.  Most of the publications are only retrievable via hand-search of references and interviews of experts. Survey revealed 44.8% respondents knew about "hand searching" [Table 3]. It is clear from the analysis that most of the researchers don't use a search strategy combining electronic and hand searching. This meant that most investigators' literature search was only partial. This emphasized the need for separate search engine for Ayurveda and importance of work of Baghel  and Narahari et al.  Although in developmental stage bibliographic databases, AYUSH Research Portal,  Digital Helpline for Ayurveda Research Articles  contain maximum citations of Ayurveda studies. PubMed has 11 journals related to Ayurveda. All three databases must be included during literature search.
Patient selection is an important step during clinical trials to reduce the selection bias. Narahari et al. discussed 12 of 16 parameters to evaluate patient selection in Ayurvedic studies.  50% of respondents identified the method of patient selection. More than half of our respondents were not able to identify different steps of clinical trial. Only 31 (54.4%) identified systematic review of randomized controlled trials (RCTs) as the highest level of evidence in evidence-based medicine [Table 3].
Forty three investigators (74.1%) did not receive any training on research methodology. Out of this, 24 (55.8%) respondents had basic qualification on Ayurveda. The research methodology was the part of their second degree and postdoctoral curriculum. Very minimal current research topics were included in older syllabus of Ayurvedic curriculum. However, the newer syllabus has some details about research methodology  without assigning any teaching faculty. Patwardhan et al. suggested reconstruction of Ayurveda study curriculum and include proper training in standard methods of research.  World Health Organization has also recommended proper training on research methodology, for TM investigators. , However, poor attention in this regard by CCIM, led to researchers in Ayurveda institutions having less than optimum level of knowledge to conduct evidence-based studies.  Forty five (78.9%) respondents were executing research projects funded by government funding agencies as well as nongovernmental agencies [Table 2]. Thirty three (74%) of them didn't have any training on research methodology. Our respondents were from multiple systems and focused on pharmacological approach. A survey revealed the dilemma among Ayurveda teaching community about conducting clinical evaluation of TM within the specific framework of rigorous clinical pharmacological principles without ignoring the Ayurvedic concepts such as Dosha, Prakruti etc. 
Twenty six (45.6%) respondents opined Ayurveda clinical trials should be conducted using both Ayurveda and biomedical diagnosis. This should be achieved by forming multi-system-doctors , and helps to generate a sufficient evidence base for wider global acceptance like success achieved through the integration with modern science in lymphedema treatment.  A literature review revealed that no studies used the Ayurvedic diagnostic criteria completely or never specified any diagnostic criteria.  However, 26 (44.82%) investigators opined that both biomedical and Ayurvedic diagnoses are needed for clinical studies and 50 (86.2%) opined that modern laboratory investigations could help in disease diagnosis and assessment of results in Ayurveda.
The Consolidated Standards of Reporting Trials (CONSORT) statement is endorsed by 50% of Biomedical journals and a few major Ayurveda journals. Only 27 (47.4%) respondents were aware of CONSORT statement. The present curriculum of post graduate programs in Ayurveda has CONSORT statement as one of the topics in the research methodology.  There are only a few RCTs conducted in Ayurveda due to its complexity of treatment delivery and personalized approach. 
The major limitation of this study was very low rate of response from the researchers. Despite reminders, we were unable to get good response rate. However, no incentives were offered for their response which is regarded as essential to get response in most questionnaire studies.  Other reasons may be that most TM investigators who publish occasionally may not be internet savvy. We have not categorized the investigators on the basis of frequency of their publications. We received only 4.9% replies through post. There is no organized portfolio for researchers in ISM.
Implications of the study
Healthcare is undoubtedly a complex interaction of challenges and intellectual exercises which result in mostly the advancement of a chosen domain of health science. Research is no different in this field. Seeking to understand the knowledge level of research investigators in an area like Ayurveda by itself is a challenging step that has been taken. The results gave a different insight for further research to be conducted, especially in the area of education system, challenges in understanding the knowledge level, need for continued education in research, research literacy and the importance of evidences in Ayurveda research. Policy makers should now be looking into the role of governmental organizations, economy, and innovations in comprehensive care and evidence-based practices to upgrade the quality of treatment delivery in health care institutions/industries. To improve on these areas which will influence an effective research, there should be optimum governance which recommends the knowledge of investigators, time frame, financial planning and management. It should also reflect a clear framework of accountability, responsibilities and quality requirements. A research audit similar to clinical audit may form a key stone for research governance and management. An efficient management of research process should keep unnecessary delays and irresponsibilities at bay. A good cross system team would be effective in solving the draw backs of uni-system analysis. Organizations and groups involved in research investigations should interact and approach a situation uniformly. Therefore, a regular study on knowledge level analysis will help in understanding the need at that point in time to achieve good advancement in TM.
Results of the present study suggest the need of research methodology training for investigators in TM especially on constructing a structured research question and conducting a comprehensive literature search. We recommend the second degree/post doctoral curriculum should include proper training on current research methodologies by faculty specialized in the same. Proper training is needed for investigators, authors and peer reviewers to ensure high quality of publications. PubMed listing of Ayurveda journals gives an opportunity for international scientific groups to critically review the quality of ISM studies and ability of complementary and alternative medicine (CAM) peer groups to filter those studies devoid of minimal standards. Globally there is an increased demand for CAM, albeit it would consolidate this gain only through evidence-based studies. Especially it is important for agencies granting public money to understand the expertise of investigators to conduct studies using sound scientific methods.
| Acknowledgment|| |
We acknowledge funding support from the National Science and Technology Management Information System (NSTMIS), Department of Science and Technology, Government of India for the study. We thank the statisticians, Mr. Suraj KR and Mr. Mohammed Shefuvan for their support.
| References|| |
World Health Organization. General Guidelines for Methodologies on Research and Evaluation of Traditional Medicine. Geneva: WHO; 2000.
Gogtay NJ, Bhatt HA, Dalvi SS, Kshirsagar NA. The use and safety of non-allopathic Indian medicines. Drug Saf 2002;25:1005-19.
Narahari SR, Aggithaya MG, Suraj KR. Conducting literature searches on Ayurveda in PubMed, Indian, and other databases. J Altern Complement Med 2010;16:1225-37.
Narahari SR, Ryan TJ, Aggithaya MG, Bose KS, Prasanna KS. Evidence-based approaches for the Ayurvedic traditional herbal formulations: Toward an Ayurvedic CONSORT model. J Altern Complement Med 2008;14:769-76.
Ramesh RP. The Drugs and Cosmetic Laws on Hospitals and Doctors. Kannur: Kannur Law Publishers; 2007. pp. 435-610.
Yadav P, Jaykaran, Chaudhari M, Saxena D, Kantharia ND. Clinical trials registered in clinical trial registry of India: A survey. J Pharmacol Pharmacother 2011;2:289-92.
Greenhalgh T. How to Read a Paper: The Basics of Evidence Based Medicine. London: BMJ Books; 2003.
Higgins JP, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. The Cochrane Collaboration,; 2011. [Last updated on 2011 March, cited 2013 July 9].
Narahari SR, Aggithaya MG, Suraj KR. A protocol for systematic reviews of Ayurveda treatments. Int J Ayurveda Res 2010;1:254-67.
Bhagel MS. Researches in Ayurveda. Gandhinagar: Mridu Ayurvedic Publication and Sales; 2006.
AYUSH Research Portal. Andhra Pradesh: National institute of Indian Medical Heritage. Available from: http://www.ayushportal.ap.nic.in/
. [Last cited on 2013 Jul 09].
Central Council of Indian Medicine. New Delhi: Dept. of AYUSH, Government of India. Syllabus for post- graduate course in Ayurveda. Available from: http://www.ccimindia.org/curriculum_ayurveda.html
. [Last updated on 2001 Aug 23; Last cited on 2002 Aug 12].
Patwardhan K, Gehlot S, Singh G, Rathore HC. Global challenges of graduate level Ayurvedic education: A survey. Int J Ayurveda Res 2010;1:49-54.
World Health Organization. Remuneration Guidelines for Non-Voluntary use of a Patent on Medical Technologies [Monograph on the Internet]. Geneva: World Health Organization; 2005. Available from: http://www.who.int/entity/hiv/amds/WHOTCM2005.1_OMS.pdf
. [Last cited on 2013 Jul 09].
Gopichandran V, Satish Kumar Ch. Mainstreaming AYUSH: An ethical analysis. Indian J Med Ethics 2012;9:272-7.
Baghel MS. Need of new research methodology for Ayurveda. AYU 2011;32:3-4.
Ramakrishna SK. Reorientation program on research methodology for Ayurveda academicians: A clinical pharmacologist′s perspective. J Ayurveda Integr Med 2012;3:57-8.
Narahari SR, Ryan TJ, Bose KS, Prasanna KS, Aggithaya GM. Integrating modern dermatology and Ayurveda in the treatment of vitiligo and lymphedema in India. Int J Dermatol 2011;50:310-34.
Singh RH. Exploring issues in the development of Ayurvedic research methodology. J Ayurveda Integr Med 2010;1:91-5.
Brar BS, Chhibber R, Srinivasa VM, Dearing BA, McGowan R, Katz RV. Use of Ayurvedic diagnostic criteria in Ayurvedic clinical trials: A literature review focused on research methods. J Altern Complement Med 2012;18:20-8.
Aggithaya MG, Narahari SR, Vijaya S, Sushma KV, Kumar NP, Prajeesh P. Navarakizhi and pinda sweda as muscle-nourishing Ayurveda procedures in hemiplegia: Double-blind randomized comparative pilot clinical trial. J Altern Complement Med 2014;20:57-64.
[Figure 1], [Figure 2], [Figure 3], [Figure 4]
[Table 1], [Table 2], [Table 3]