{"id":5095,"date":"2011-10-24T10:27:22","date_gmt":"2011-10-24T14:27:22","guid":{"rendered":"\/news_blogs\/john\/?p=5095"},"modified":"2023-12-22T12:58:14","modified_gmt":"2023-12-22T17:58:14","slug":"program-evaluation-3-literature-review","status":"publish","type":"post","link":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/","title":{"rendered":"Program Evaluation 3 &#8211; Literature Review"},"content":{"rendered":"<div class=\"pps-series-post-details pps-series-post-details-variant-classic pps-series-post-details-38706\" data-series-id=\"124\"><div class=\"pps-series-meta-content\"><div class=\"pps-series-meta-text\">This entry is part 3 of 7 in the series <a href=\"https:\/\/www.cccc.org\/news_blogs\/series\/program-evaluation\/\">Program Evaluation<\/a><\/div><\/div><\/div>\n<p>Having <a title=\"Program Evaluation 1: Selecting the program\" href=\"\/news_blogs\/john\/2011\/10\/14\/program-evaluation-1-selecting-the-program\/\" target=\"_blank\" rel=\"noopener\">selected a program <\/a>to evaluate and defined the <a title=\"Program Evaluation 2 \u2013 Program rationale\" href=\"\/news_blogs\/john\/2011\/10\/19\/program-evaluation-2-the-logic-model\/\" target=\"_blank\" rel=\"noopener\">program&#8217;s rationale<\/a>, we turn to&nbsp;the<strong> literature review<\/strong>. A well done literature review will identify issues to research and generate new knowledge and insights that should lead to a cutting-edge program. Here&#8217;s how to do one well.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Program Evaluation 3 Literature review\" width=\"625\" height=\"352\" src=\"https:\/\/www.youtube.com\/embed\/zKoWDHee_RM?start=8&#038;feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>How a Literature Review Helps<\/strong><\/h2>\n\n\n\n<p>A literature review will:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Broaden your thinking by providing context for the issue. It&#8217;s possible to be so consumed with the immediate work at hand that you miss the big picture. A lit review will&nbsp;correct that. An inner-city mission might be founded to feed the hungry. As they read about hunger they will find that it is very much related to poverty and poverty is related to several issues, including mental health and joblessness. So&nbsp;the&nbsp;mission might add counselling and job skills training to its services. But causes related to individuals are just part of the problem because there are systemic reasons why poverty exists. So the inner-city mission may engage in advocacy work, seeking legislative change or systemic change that will help minimize poverty. A literature review will help you think BIG BROAD thoughts!<\/li><li>Take you deeper into the nuances of the&nbsp;issue. It will help you think DEEP thoughts. While writing my dissertation about church-agency relations, I started with the understanding that the divisive issue between them was one of control. Most of the authors framed their discussions this way, and yet as I did the literature review and dug below the surface of their arguments, I realized control wasn&#8217;t the issue &#8211; responsible relationship was. The solution to the problem could not be resolved if the debate centred on control, but it is easily resolved once we address the underlying goal that was shared by every one of the authors. This is the subject of my book <em>The Church At Work: A manual for church-agency relationships<\/em> that will be coming out by the end of the year. Exploring the breadth and depth of your mission will stimulate all sorts of creative ideas.<br><a href=\"\/news_blogs\/wp-content\/uploads\/2011\/10\/Cover-Church-at-Work.png\"><img loading=\"lazy\" decoding=\"async\" title=\"Cover Church at Work\" width=\"199\" height=\"300\" class=\"aligncenter size-medium wp-image-9348\" src=\"\/news_blogs\/wp-content\/uploads\/2011\/10\/Cover-Church-at-Work-199x300.png\" alt=\"Cover of The Church At Work\" srcset=\"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2011\/10\/Cover-Church-at-Work.png?resize=199%2C300&amp;ssl=1 199w, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2011\/10\/Cover-Church-at-Work.png?w=523&amp;ssl=1 523w\" sizes=\"auto, (max-width: 199px) 100vw, 199px\" \/><\/a><\/li><li>Reveal the points of controversy and the resulting key choices you need to make. Let&#8217;s say you are a Bible study ministry producing educational materials. A literature review will show that adults and children learn differently and that there are various theories of learning that compete with each other. There are methods of studying the Bible that compete with each other too. There is even controversy over which version of the Bible is the best one to use for study. There are many choices to be made in each of these topic areas and by understanding the points of controversy or divergence, you can make an intelligent decision for what your ministry will do and you&#8217;ll know why it is the best choice.<\/li><li>Keep you up to date in your field. Missiology, for example, has changed enormously in the last 50 years, and even the last 10 years. If you are a sending agency and are still using a missions model developed in the 1950s or 1960s, you are badly out of date. Missiologists have changed their thinking on relationships between sending and receiving countries and created a new paradigm for global mission. Not only has the theory changed, but so have the practices. A lit review will help you be a leading-edge ministry.<\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>What to Do a Literature Review On<\/strong><\/h2>\n\n\n\n<p>Review your <strong>theory of change<\/strong> and<strong> logic model<\/strong> to find researchable topics. The topics might not be explicitly listed, but look at each box and ask, &#8220;What topics are related to this box?&#8221; Based on my <a title=\"Program Evaluation 2 \u2013 Program rationale\" href=\"\/news_blogs\/john\/2011\/10\/19\/program-evaluation-2-the-logic-model\/\" target=\"_blank\" rel=\"noopener\">previous post <\/a>about the program review of our annual conference, some possible&nbsp;researchable topics for our program review include:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>conferences: trends, promotion, logistics, why people attend, business models etc.<\/li><li>adult learning theory and converting learning into doing<\/li><li>networking<\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>How&nbsp;to Find the Literature<\/strong><\/h2>\n\n\n\n<ul class=\"wp-block-list\"><li>Books often have the most thorough treatments of a topic. Look especially for recent books based on primary research. For help in selecting books, read this <a title=\"An excessive devotion to books\" href=\"\/news_blogs\/john\/2009\/10\/13\/an-excessive-devotion-to-books\/\" target=\"_blank\" rel=\"noopener\">post<\/a>. Don&#8217;t forget to go to the library to see what you can borrow before buying a bunch of books.<\/li><li>Online websites, blogs and journals are where you will likely find the most up-to-date material. If you are referred to journals that only have excerpts, or if you have to pay for the information, check if your your local university, college or seminary subscribes to the journal. If not, you can likely do the search from within the library and see the results because they have already paid for access to databases of journals and you can read them or print them out at the library.<\/li><li>Ask people to recommend sources for you. If they are in the same field as you, they can usually recommend either a title or an author.<\/li><li>You can stop looking for additional literature when you find that all of the citations and references are to articles and books you&#8217;ve already seen, or when you find the material has become repetitious.<\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>How to Analyze the Literature<\/strong><\/h2>\n\n\n\n<p>First of all, the purpose of this literature review is to design better programs and services. For a real-life excellent example of how to do the lit review, see Andy Harrington&#8217;s example which I highlight <a title=\"A great example of organizational self-examination\" href=\"\/news_blogs\/john\/2011\/10\/25\/a-great-example-of-organizational-self-examination\/\" target=\"_blank\" rel=\"noopener\">here<\/a>. Since you are <em>not<\/em> doing an academic literature review, the only issue to resolve is whether or not the information is useful to your ministry. How you analyze the literature depends on whether you are reading about application and execution (to tweak a program) or about ideas and theories (to test the design of the program).<\/p>\n\n\n\n<p>If you are looking for application and execution ideas, you simply make a list of the ones you find in the lit review that you want to consider. For example,&nbsp;a list of&nbsp;technologies&nbsp;that can enhance a conference experience. If you are researching at the theoretical or idea level, then you have some additional&nbsp;work to do to&nbsp;get below the surface of differing opinions:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>What are the premises on which the various opinions are based? Are they valid? Do they apply to your situation? Especially in the social and political spheres, you have to ask if the premises and conclusions&nbsp;are&nbsp;theologically acceptable.<\/li><li>What are the authors&#8217; goals and values? Can you reconcile their various views? Can some be discarded because they conflict with your goals and values? Sometimes their goals and values are explicit and sometimes not, in which case you have to try to infer them. In my dissertation research on church-agency relations I discovered that some authors were primarily concerned that individuals be able to use their gifts while others were more&nbsp;concerned about showing unity to the public. Some had a Christological focus while others had a Trinitarian focus. Some used very strong language heavy on the &#8216;control&#8217; aspect yet when they gave examples of what the relationship should be, the examples were much more moderate in tone. I was able to reconcile the positions of authors who at first appeared to be diametrically opposed to each other. The result was a new model of church-agency relations that all of the authors should be able to live with. In fact, one of the authors I critiqued read my work and said he agreed with the end result even as he disagreed on how I got there!<\/li><li>Finally, look at the recommended action steps or the model they propose. Have they made a convincing argument to support their recommendations? Do&nbsp;they make sense to you?<\/li><\/ul>\n\n\n\n<figure class=\"wp-block-image size-thumbnail\"><a href=\"https:\/\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2022\/08\/Program-Evaluation-3-Literature-Review.pdf\" target=\"_blank\" rel=\"noopener\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"150\" height=\"150\" src=\"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2022\/08\/Program-Evaluation-3-Literature-Review.jpg?resize=150%2C150&#038;ssl=1\" alt=\"\" class=\"wp-image-34929\" srcset=\"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2022\/08\/Program-Evaluation-3-Literature-Review.jpg?resize=150%2C150&amp;ssl=1 150w, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2022\/08\/Program-Evaluation-3-Literature-Review.jpg?zoom=2&amp;resize=150%2C150&amp;ssl=1 300w, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2022\/08\/Program-Evaluation-3-Literature-Review.jpg?zoom=3&amp;resize=150%2C150&amp;ssl=1 450w\" sizes=\"auto, (max-width: 150px) 100vw, 150px\" \/><\/a><figcaption><em>Download discussion guide<\/em><\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">&nbsp;<strong>The Outcomes of a Literature Review<\/strong><\/h2>\n\n\n\n<ul class=\"wp-block-list\"><li>A literature review should make you aware of what the choices are for how your program is designed and delivered. Based on this, the program review would then assess if the current design would benefit from a change.<\/li><li>It may determine questions you should ask as you do the program evaluation.<\/li><li>It should help you identify hidden assumptions you have made, which you can then test to see if they are valid.<\/li><li>It might suggest that some further research is needed in a particular area.<\/li><li>It could provide a shopping list of enhancements to the current program or a list of ideas for new programs and services.<\/li><\/ul>\n\n\n\n<p>Conducting a literature review will help ensure that, as you progress through the program evaluation, you are well informed and up to date on the subject you are evaluating, and it will help you focus on the areas that need more scrutiny.<\/p>\n\n\n\n<figure class=\"wp-block-audio\"><audio controls src=\"https:\/\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2014\/08\/Program-Evaluation-3.mp3\"><\/audio><\/figure>\n","protected":false},"excerpt":{"rendered":"<div class=\"pps-series-post-details pps-series-post-details-variant-classic pps-series-post-details-38706 pps-series-meta-excerpt\" data-series-id=\"124\"><div class=\"pps-series-meta-content\"><div class=\"pps-series-meta-text\">This entry is part 3 of 7 in the series <a href=\"https:\/\/www.cccc.org\/news_blogs\/series\/program-evaluation\/\">Program Evaluation<\/a><\/div><\/div><\/div><p>A well done literature review will identify issues to research and generate new knowledge and insights that should lead to a cutting-edge program. Here&#8217;s how to do one well. <a href=\"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/\" class=\"linkbutton\">More<\/a><\/p>\n","protected":false},"author":2,"featured_media":30274,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ts_fic_featured_image_caption":"Piles of books stacked in columns on a table. <span>Photo by <a href=\"https:\/\/unsplash.com\/@freestocks?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText\">freestocks<\/a> on <a href=\"https:\/\/unsplash.com\/?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText\">Unsplash<\/a><\/span>","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[562,559,221],"tags":[53,611],"series":[124],"class_list":["post-5095","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-intellectual-creativity","category-exemplary","category-leadership-organizational","tag-evaluation","tag-research-based","series-program-evaluation"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Program Evaluation 3 - Literature Review - CCCC Blogs<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Program Evaluation 3 - Literature Review - CCCC Blogs\" \/>\n<meta property=\"og:description\" content=\"A well done literature review will identify issues to research and generate new knowledge and insights that should lead to a cutting-edge program. Here&#039;s how to do one well. More\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/\" \/>\n<meta property=\"og:site_name\" content=\"CCCC Blogs\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/CCCCCharities\" \/>\n<meta property=\"article:published_time\" content=\"2011-10-24T14:27:22+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-12-22T17:58:14+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2021\/01\/freestocks-RgKmrxpIraY-unsplash-scaled.jpg?fit=2560%2C1707&ssl=1\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1707\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"John Pellowe\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@cccccharities\" \/>\n<meta name=\"twitter:site\" content=\"@cccccharities\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"John Pellowe\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/\"},\"author\":{\"name\":\"John Pellowe\",\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/#\\\/schema\\\/person\\\/78129b8fafee8dfe3bb7f3d7c8e33569\"},\"headline\":\"Program Evaluation 3 &#8211; Literature Review\",\"datePublished\":\"2011-10-24T14:27:22+00:00\",\"dateModified\":\"2023-12-22T17:58:14+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/\"},\"wordCount\":1445,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i0.wp.com\\\/www.cccc.org\\\/news_blogs\\\/wp-content\\\/uploads\\\/2021\\\/01\\\/freestocks-RgKmrxpIraY-unsplash-scaled.jpg?fit=2560%2C1707&ssl=1\",\"keywords\":[\"Evaluation\",\"Research-Based\"],\"articleSection\":[\"Creativity\",\"Exemplary\",\"Organizational Leadership\"],\"inLanguage\":\"en-CA\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/\",\"url\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/\",\"name\":\"Program Evaluation 3 - Literature Review - CCCC Blogs\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i0.wp.com\\\/www.cccc.org\\\/news_blogs\\\/wp-content\\\/uploads\\\/2021\\\/01\\\/freestocks-RgKmrxpIraY-unsplash-scaled.jpg?fit=2560%2C1707&ssl=1\",\"datePublished\":\"2011-10-24T14:27:22+00:00\",\"dateModified\":\"2023-12-22T17:58:14+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/#breadcrumb\"},\"inLanguage\":\"en-CA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-CA\",\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/#primaryimage\",\"url\":\"https:\\\/\\\/i0.wp.com\\\/www.cccc.org\\\/news_blogs\\\/wp-content\\\/uploads\\\/2021\\\/01\\\/freestocks-RgKmrxpIraY-unsplash-scaled.jpg?fit=2560%2C1707&ssl=1\",\"contentUrl\":\"https:\\\/\\\/i0.wp.com\\\/www.cccc.org\\\/news_blogs\\\/wp-content\\\/uploads\\\/2021\\\/01\\\/freestocks-RgKmrxpIraY-unsplash-scaled.jpg?fit=2560%2C1707&ssl=1\",\"width\":2560,\"height\":1707,\"caption\":\"Photo by freestocks on Unsplash\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/john\\\/2011\\\/10\\\/24\\\/program-evaluation-3-literature-review\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Program Evaluation 3 &#8211; Literature Review\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/#website\",\"url\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/\",\"name\":\"CCCC News &amp; Blogs\",\"description\":\"CCCC Blogs\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-CA\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/#organization\",\"name\":\"Canadian Centre for Christian Charities\",\"url\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-CA\",\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/i0.wp.com\\\/www.cccc.org\\\/news_blogs\\\/wp-content\\\/uploads\\\/2020\\\/10\\\/260wbRGB.png?fit=260%2C260&ssl=1\",\"contentUrl\":\"https:\\\/\\\/i0.wp.com\\\/www.cccc.org\\\/news_blogs\\\/wp-content\\\/uploads\\\/2020\\\/10\\\/260wbRGB.png?fit=260%2C260&ssl=1\",\"width\":260,\"height\":260,\"caption\":\"Canadian Centre for Christian Charities\"},\"image\":{\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/CCCCCharities\",\"https:\\\/\\\/x.com\\\/cccccharities\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/canadian-council-of-christian-charities\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/#\\\/schema\\\/person\\\/78129b8fafee8dfe3bb7f3d7c8e33569\",\"name\":\"John Pellowe\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-CA\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e5439962feafa2554de0378f025969e5215f2a92edf5742f1bf3bed1765d6304?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e5439962feafa2554de0378f025969e5215f2a92edf5742f1bf3bed1765d6304?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e5439962feafa2554de0378f025969e5215f2a92edf5742f1bf3bed1765d6304?s=96&d=mm&r=g\",\"caption\":\"John Pellowe\"},\"sameAs\":[\"https:\\\/\\\/www.cccc.org\",\"bonnie.pillsworth@cccc.org\"],\"url\":\"https:\\\/\\\/www.cccc.org\\\/news_blogs\\\/author\\\/john\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Program Evaluation 3 - Literature Review - CCCC Blogs","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/","og_locale":"en_US","og_type":"article","og_title":"Program Evaluation 3 - Literature Review - CCCC Blogs","og_description":"A well done literature review will identify issues to research and generate new knowledge and insights that should lead to a cutting-edge program. Here's how to do one well. More","og_url":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/","og_site_name":"CCCC Blogs","article_publisher":"https:\/\/www.facebook.com\/CCCCCharities","article_published_time":"2011-10-24T14:27:22+00:00","article_modified_time":"2023-12-22T17:58:14+00:00","og_image":[{"width":2560,"height":1707,"url":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2021\/01\/freestocks-RgKmrxpIraY-unsplash-scaled.jpg?fit=2560%2C1707&ssl=1","type":"image\/jpeg"}],"author":"John Pellowe","twitter_card":"summary_large_image","twitter_creator":"@cccccharities","twitter_site":"@cccccharities","twitter_misc":{"Written by":"John Pellowe","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/#article","isPartOf":{"@id":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/"},"author":{"name":"John Pellowe","@id":"https:\/\/www.cccc.org\/news_blogs\/#\/schema\/person\/78129b8fafee8dfe3bb7f3d7c8e33569"},"headline":"Program Evaluation 3 &#8211; Literature Review","datePublished":"2011-10-24T14:27:22+00:00","dateModified":"2023-12-22T17:58:14+00:00","mainEntityOfPage":{"@id":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/"},"wordCount":1445,"commentCount":0,"publisher":{"@id":"https:\/\/www.cccc.org\/news_blogs\/#organization"},"image":{"@id":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2021\/01\/freestocks-RgKmrxpIraY-unsplash-scaled.jpg?fit=2560%2C1707&ssl=1","keywords":["Evaluation","Research-Based"],"articleSection":["Creativity","Exemplary","Organizational Leadership"],"inLanguage":"en-CA","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/","url":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/","name":"Program Evaluation 3 - Literature Review - CCCC Blogs","isPartOf":{"@id":"https:\/\/www.cccc.org\/news_blogs\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/#primaryimage"},"image":{"@id":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2021\/01\/freestocks-RgKmrxpIraY-unsplash-scaled.jpg?fit=2560%2C1707&ssl=1","datePublished":"2011-10-24T14:27:22+00:00","dateModified":"2023-12-22T17:58:14+00:00","breadcrumb":{"@id":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/#breadcrumb"},"inLanguage":"en-CA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/"]}]},{"@type":"ImageObject","inLanguage":"en-CA","@id":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/#primaryimage","url":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2021\/01\/freestocks-RgKmrxpIraY-unsplash-scaled.jpg?fit=2560%2C1707&ssl=1","contentUrl":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2021\/01\/freestocks-RgKmrxpIraY-unsplash-scaled.jpg?fit=2560%2C1707&ssl=1","width":2560,"height":1707,"caption":"Photo by freestocks on Unsplash"},{"@type":"BreadcrumbList","@id":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/24\/program-evaluation-3-literature-review\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.cccc.org\/news_blogs\/"},{"@type":"ListItem","position":2,"name":"Program Evaluation 3 &#8211; Literature Review"}]},{"@type":"WebSite","@id":"https:\/\/www.cccc.org\/news_blogs\/#website","url":"https:\/\/www.cccc.org\/news_blogs\/","name":"CCCC News &amp; Blogs","description":"CCCC Blogs","publisher":{"@id":"https:\/\/www.cccc.org\/news_blogs\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.cccc.org\/news_blogs\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-CA"},{"@type":"Organization","@id":"https:\/\/www.cccc.org\/news_blogs\/#organization","name":"Canadian Centre for Christian Charities","url":"https:\/\/www.cccc.org\/news_blogs\/","logo":{"@type":"ImageObject","inLanguage":"en-CA","@id":"https:\/\/www.cccc.org\/news_blogs\/#\/schema\/logo\/image\/","url":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2020\/10\/260wbRGB.png?fit=260%2C260&ssl=1","contentUrl":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2020\/10\/260wbRGB.png?fit=260%2C260&ssl=1","width":260,"height":260,"caption":"Canadian Centre for Christian Charities"},"image":{"@id":"https:\/\/www.cccc.org\/news_blogs\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/CCCCCharities","https:\/\/x.com\/cccccharities","https:\/\/www.linkedin.com\/company\/canadian-council-of-christian-charities"]},{"@type":"Person","@id":"https:\/\/www.cccc.org\/news_blogs\/#\/schema\/person\/78129b8fafee8dfe3bb7f3d7c8e33569","name":"John Pellowe","image":{"@type":"ImageObject","inLanguage":"en-CA","@id":"https:\/\/secure.gravatar.com\/avatar\/e5439962feafa2554de0378f025969e5215f2a92edf5742f1bf3bed1765d6304?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/e5439962feafa2554de0378f025969e5215f2a92edf5742f1bf3bed1765d6304?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e5439962feafa2554de0378f025969e5215f2a92edf5742f1bf3bed1765d6304?s=96&d=mm&r=g","caption":"John Pellowe"},"sameAs":["https:\/\/www.cccc.org","bonnie.pillsworth@cccc.org"],"url":"https:\/\/www.cccc.org\/news_blogs\/author\/john\/"}]}},"jetpack_featured_media_url":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2021\/01\/freestocks-RgKmrxpIraY-unsplash-scaled.jpg?fit=2560%2C1707&ssl=1","jetpack-related-posts":[{"id":30002,"url":"https:\/\/www.cccc.org\/news_blogs\/john\/2021\/01\/04\/most-popular-posts\/","url_meta":{"origin":5095,"position":0},"title":"Most Popular Posts","author":"John Pellowe","date":"January 4, 2021","format":false,"excerpt":"Here are the top ten most popular posts in two lists - one for 2020 and one for all-time. Interestingly, five of 2020's top ten most popular posts are also on the list of all-time most popular posts.","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"Children sorting Easter eggs by colour","src":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2020\/12\/Sorting.jpg?fit=1200%2C801&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2020\/12\/Sorting.jpg?fit=1200%2C801&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2020\/12\/Sorting.jpg?fit=1200%2C801&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2020\/12\/Sorting.jpg?fit=1200%2C801&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2020\/12\/Sorting.jpg?fit=1200%2C801&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":5093,"url":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/12\/03\/program-evaluation-4-research-design\/","url_meta":{"origin":5095,"position":1},"title":"Program Evaluation 4 &#8211; Research Design","author":"John Pellowe","date":"December 3, 2011","format":false,"excerpt":"How to determine what a program's assumptions are and why you think the program works, and then how to decide what the evaluation should research and test.","rel":"","context":"In &quot;Effective&quot;","block_context":{"text":"Effective","link":"https:\/\/www.cccc.org\/news_blogs\/category\/effective\/"},"img":{"alt_text":"Microscope","src":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2011\/12\/Microscope-Freeimages.jpg?fit=840%2C1200&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2011\/12\/Microscope-Freeimages.jpg?fit=840%2C1200&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2011\/12\/Microscope-Freeimages.jpg?fit=840%2C1200&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2011\/12\/Microscope-Freeimages.jpg?fit=840%2C1200&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":5101,"url":"https:\/\/www.cccc.org\/news_blogs\/john\/2012\/02\/02\/program-evaluation-5-wrapping-it-up\/","url_meta":{"origin":5095,"position":2},"title":"Program Evaluation 5 &#8211; Wrapping It Up","author":"John Pellowe","date":"February 2, 2012","format":false,"excerpt":"Well, the program review is now complete and it is time to figure out what to do with the results.\u00a0 The process started with selecting which program to evaluate and went on from there with development of the theory of change and logic model, the literature review, and then the\u2026","rel":"","context":"In &quot;Effective&quot;","block_context":{"text":"Effective","link":"https:\/\/www.cccc.org\/news_blogs\/category\/effective\/"},"img":{"alt_text":"Wrapped gift with a bow","src":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2012\/02\/Wrapped-gift.jpg?fit=639%2C770&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2012\/02\/Wrapped-gift.jpg?fit=639%2C770&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2012\/02\/Wrapped-gift.jpg?fit=639%2C770&ssl=1&resize=525%2C300 1.5x"},"classes":[]},{"id":9352,"url":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/25\/a-great-example-of-organizational-self-examination\/","url_meta":{"origin":5095,"position":3},"title":"A Great Example of Organizational Self-Examination","author":"John Pellowe","date":"October 25, 2011","format":false,"excerpt":"Successful ministries ask tough questions about performance. One ministry is sharing its report, which is a model literature review and performance analysis,","rel":"","context":"In &quot;Effective&quot;","block_context":{"text":"Effective","link":"https:\/\/www.cccc.org\/news_blogs\/category\/effective\/"},"img":{"alt_text":"A tabletop face mirror","src":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2009\/08\/Mirror-sxc.jpg?fit=1200%2C795&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2009\/08\/Mirror-sxc.jpg?fit=1200%2C795&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2009\/08\/Mirror-sxc.jpg?fit=1200%2C795&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2009\/08\/Mirror-sxc.jpg?fit=1200%2C795&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2009\/08\/Mirror-sxc.jpg?fit=1200%2C795&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":5049,"url":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/14\/program-evaluation-1-selecting-the-program\/","url_meta":{"origin":5095,"position":4},"title":"Program Evaluation 1 &#8211; Selecting the Program","author":"John Pellowe","date":"October 14, 2011","format":false,"excerpt":"Here are some factors to help you decide which program you should review next.","rel":"","context":"In &quot;Effective&quot;","block_context":{"text":"Effective","link":"https:\/\/www.cccc.org\/news_blogs\/category\/effective\/"},"img":{"alt_text":"Multiple Choice test","src":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2011\/10\/Multiple-Choice-Freeimages.jpg?fit=767%2C1200&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2011\/10\/Multiple-Choice-Freeimages.jpg?fit=767%2C1200&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2011\/10\/Multiple-Choice-Freeimages.jpg?fit=767%2C1200&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2011\/10\/Multiple-Choice-Freeimages.jpg?fit=767%2C1200&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":5091,"url":"https:\/\/www.cccc.org\/news_blogs\/john\/2011\/10\/19\/program-evaluation-2-program-rationale\/","url_meta":{"origin":5095,"position":5},"title":"Program Evaluation 2 &#8211; Program Rationale","author":"John Pellowe","date":"October 19, 2011","format":false,"excerpt":"Every program evaluation needs to be based on the rationale for why the program exists in the first place. Individual programs only exist because they support the ministry's theory of change that describes how its vision will be accomplished through its programs. Only then can you develop a rationale for\u2026","rel":"","context":"In &quot;Exemplary&quot;","block_context":{"text":"Exemplary","link":"https:\/\/www.cccc.org\/news_blogs\/category\/exemplary\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2021\/11\/shutterstock_154767518-scaled.jpg?fit=1200%2C847&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2021\/11\/shutterstock_154767518-scaled.jpg?fit=1200%2C847&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2021\/11\/shutterstock_154767518-scaled.jpg?fit=1200%2C847&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2021\/11\/shutterstock_154767518-scaled.jpg?fit=1200%2C847&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.cccc.org\/news_blogs\/wp-content\/uploads\/2021\/11\/shutterstock_154767518-scaled.jpg?fit=1200%2C847&ssl=1&resize=1050%2C600 3x"},"classes":[]}],"jetpack_shortlink":"https:\/\/wp.me\/p30X8p-1kb","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/www.cccc.org\/news_blogs\/wp-json\/wp\/v2\/posts\/5095","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.cccc.org\/news_blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.cccc.org\/news_blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.cccc.org\/news_blogs\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.cccc.org\/news_blogs\/wp-json\/wp\/v2\/comments?post=5095"}],"version-history":[{"count":0,"href":"https:\/\/www.cccc.org\/news_blogs\/wp-json\/wp\/v2\/posts\/5095\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.cccc.org\/news_blogs\/wp-json\/wp\/v2\/media\/30274"}],"wp:attachment":[{"href":"https:\/\/www.cccc.org\/news_blogs\/wp-json\/wp\/v2\/media?parent=5095"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.cccc.org\/news_blogs\/wp-json\/wp\/v2\/categories?post=5095"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.cccc.org\/news_blogs\/wp-json\/wp\/v2\/tags?post=5095"},{"taxonomy":"series","embeddable":true,"href":"https:\/\/www.cccc.org\/news_blogs\/wp-json\/wp\/v2\/series?post=5095"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}