<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "https://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article" dtd-version="1.2" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">IJJMCR</journal-id>
<journal-title-group><journal-title>International Journal of Journalism and Mass Communication Research</journal-title></journal-title-group>
<publisher><publisher-name>Thomson &amp; Ryberg Publications</publisher-name></publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.62715/ijjmcr.2026.v1.i1.pp7-12</article-id>
<article-id pub-id-type="publisher-id">76b245975d</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Methodology Article</subject></subj-group></article-categories>
<title-group><article-title>Designing and Evaluating a Reader Membership Trial in a Regional Newsroom After Advertising Revenue Collapse: A Methodological Framework</article-title></title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes"><name><surname>Sundararajan</surname><given-names>Selam</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1">*</xref></contrib>
<contrib contrib-type="author"><name><surname>Tran</surname><given-names>Satoshi</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Prescod</surname><given-names>Ivana</given-names></name><xref ref-type="aff" rid="aff3"><sup>3</sup></xref></contrib>
<aff id="aff1"><label>1</label>Department of Social Sciences, Altai Graduate Institute of Social Sciences, Japan</aff>
<aff id="aff2"><label>2</label>Department of Social Sciences, Chaliyar University Centre for Social Sciences, Bulgaria</aff>
<aff id="aff3"><label>3</label>Department of Social Sciences, Bharathapuzha Institute of Social Sciences, Guyana</aff>
</contrib-group>
<author-notes><corresp id="cor1">* Correspondence: <email>selam.sundararajan@altai.edu</email></corresp></author-notes>
<pub-date pub-type="epub" iso-8601-date="2026-02-18"><day>18</day><month>02</month><year>2026</year></pub-date>
<volume>1</volume>
<issue>1</issue>
<fpage>7</fpage>
<lpage>12</lpage>
<history>
<date date-type="received" iso-8601-date="2025-11-04"><day>04</day><month>11</month><year>2025</year></date>
<date date-type="accepted" iso-8601-date="2025-12-21"><day>21</day><month>12</month><year>2025</year></date>
</history>
<permissions><copyright-statement>© 2026 The Author(s)</copyright-statement><copyright-year>2026</copyright-year><license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/"><license-p>This is an open access article distributed under the Creative Commons Attribution 4.0 International License (CC BY 4.0).</license-p></license></permissions>
<self-uri xlink:href="https://trpub.org/article.php?id=76b245975d"/>
<abstract><p>Regional news organisations that have lost most of their advertising income are frequently advised to ask readers for support, and many have launched membership schemes with little means of telling afterwards whether the scheme worked or why. This article proposes a framework for running such a launch as a structured trial. It distinguishes membership from subscription and donation, reviews what published research says about willingness to pay for local news, and then sets out six phases: a baseline audit, a listening phase with readers, a written statement of the offer with hypotheses and stopping rules, a staged launch that allows planned comparisons, retention tracking by joining cohort, and a formal review. For each phase the article states the purpose, the records to be kept and the decisions that depend on them. It also discusses measures, including conversion, retention, participation and the editorial time the scheme consumes, and the safeguards needed for reader data and editorial independence. The framework is drawn from the literature on audience revenue, on controlled and quasi-experimental designs and on case study method. It is a proposal and has not been applied or validated here; the conditions under which it could be tested are described.</p></abstract>
<kwd-group kwd-group-type="author">
<kwd>Reader revenue</kwd>
<kwd>Membership models</kwd>
<kwd>Local journalism</kwd>
<kwd>Newsroom experiments</kwd>
<kwd>Audience engagement</kwd>
<kwd>Media business models</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="sec1"><title>1. Introduction</title>
<p>The business of regional news was built on local advertising: classified notices, property, motoring, recruitment and the display space bought by nearby retailers. Most of that income has moved to search engines, social platforms and specialist listing sites, and the consequences for local reporting are well documented. Titles have closed or merged, newsrooms have shrunk, and areas without any regular local coverage have multiplied (Abernathy, 2018; Nielsen, 2015). Pickard (2020) treats the collapse as a structural market failure and not a passing adjustment.</p>
<p>Reader revenue is the response most often recommended to publishers who remain. Paywalls were the first form, and their record for general news at regional scale is modest (Myllylahti, 2014; Chyi and Ng, 2020). Membership, in which readers are asked to support journalism that stays wholly or largely open and are offered a closer relationship in return, has been promoted as better suited to publications with a strong local identity and a small potential market (Hansen and Goligoski, 2018). What a newsroom seldom has is a way of launching such a scheme so that it can later say, with evidence, what happened and why.</p>
<p>This article proposes one. It describes a six-phase framework for designing, running and evaluating a membership trial in a regional newsroom. The framework is assembled from published guidance and from standard thinking on experiments in organisations. It is offered as a proposed design. It has not been applied in a newsroom for the purposes of this article, and no results are reported.</p>
</sec>
<sec id="sec2"><title>2. Background</title>
<p>Three bodies of work inform the design: the distinction between membership and other forms of reader payment, research on who pays for news and why, and the methods available for learning from a single organisation&#x27;s experience.</p>
<sec id="sec2-2"><title>2.1. Membership, subscription and donation</title>
<p>The Tow Center guide by Hansen and Goligoski (2018) separates three models. Subscription is a transaction: payment buys access to a product. Donation is a gift to a cause, with nothing expected in return. Membership sits between them. Members give money, and often time, knowledge or contacts, because they believe in the organisation&#x27;s purpose, and the organisation in turn opens itself to them. The Membership Puzzle Project developed this idea into practical guidance and stressed that the relationship must be designed before the payment page (Membership Puzzle Project, 2020). The underlying notion is close to what Lewis et al. (2014) call reciprocal journalism, in which journalists and audiences exchange benefits over time and trust accumulates through the exchange.</p>
</sec>
<sec id="sec2-3"><title>2.2. What is known about paying for local news</title>
<p>Comparative survey work finds that only a minority of people in most countries pay for online news, that payment is associated with age, interest in news and an existing habit of paying for print, and that those who do not pay often say free alternatives are sufficient (Fletcher and Nielsen, 2017). A systematic review of the drivers of willingness to pay reaches similar conclusions and notes how much of the evidence rests on stated intention and not on observed behaviour (O&#x27;Brien et al., 2020). Studies of regional newspapers add two cautions. Introducing a paywall can reduce traffic and with it the title&#x27;s civic reach (Olsen et al., 2020), and stated intent to pay for a digital edition is weak when the same content has long been free (Chyi, 2012). A newsroom planning membership should therefore expect a small core of supporters, should measure what people do and not what they say, and should watch for effects on readership as well as revenue.</p>
</sec>
<sec id="sec2-4"><title>2.3. Learning from one organisation</title>
<p>A regional title has one market and one launch. It cannot randomise towns. Two traditions help. Within a website, visitors can be allocated at random to alternative versions of a message or page, and the conditions under which such online controlled experiments give trustworthy answers are well described (Kohavi et al., 2020). Where randomisation is impossible, quasi-experimental designs such as interrupted time series and staggered introduction offer weaker but still disciplined inference, provided the threats to validity are named in advance (Shadish et al., 2002). Qualitative evidence from interviews and documents is best organised as a case study with a stated protocol (Yin, 2018).</p>
</sec>
</sec>
<sec id="sec3"><title>3. The Proposed Framework</title>
<p>The framework has six phases, shown in sequence in Figure 1. Table 1 lists what each phase is for and the record it should leave. The phases are described below in the order a newsroom would meet them. The durations a newsroom assigns to each will depend on its size; the order should not change.</p>
<table-wrap id="tbl1"><label>Table 1</label><caption><p>Phases of the proposed membership trial, with the purpose of each and the record it leaves</p></caption><table frame="hsides" rules="groups"><thead><tr><th>Phase</th><th>Purpose</th><th>Main activities</th><th>Record kept</th></tr></thead><tbody><tr><td>1. Baseline audit</td><td>Fix the starting point</td><td>Revenue by source, loyal audience size, costs</td><td>Baseline report</td></tr><tr><td>2. Listening</td><td>Learn what readers value</td><td>Survey, interviews, open meetings</td><td>Agreed summary of findings</td></tr><tr><td>3. Offer and rules</td><td>Commit before launch</td><td>Write offer, hypotheses, thresholds</td><td>Dated trial plan</td></tr><tr><td>4. Staged launch</td><td>Allow fair comparison</td><td>Randomised appeals; staggered channels</td><td>Allocation log and results</td></tr><tr><td>5. Retention tracking</td><td>Separate joining from staying</td><td>Follow each cohort through renewals</td><td>Cohort tables</td></tr><tr><td>6. Review</td><td>Decide on evidence</td><td>Compare outcomes with the rules</td><td>Review memorandum</td></tr></tbody></table></table-wrap>
<fig id="fig1"><label>Figure 1</label><caption><p>The six phases of the proposed membership trial, from baseline audit to formal review</p></caption><graphic xlink:href="IJJMCR_V1I1_2026_02_Figure1.png" mimetype="image" mime-subtype="png"/></fig>
<sec id="sec3-2"><title>3.1. Phase 1: Baseline audit</title>
<p>Before anything is offered, the newsroom records where it stands. The audit covers revenue by source for at least the preceding two years, so that seasonal patterns are visible; audience measures, separating occasional visitors from the regular local readers who are the realistic market for membership; existing direct relationships such as newsletter lists and print subscribers; and the cost of the journalism the scheme is meant to sustain. Picard (2011) gives the standard account of how media revenues and cost structures should be analysed. The audit fixes the comparison against which later change is judged, and it often shows that the newsroom does not know how many loyal readers it has.</p>
</sec>
<sec id="sec3-3"><title>3.2. Phase 2: Listening</title>
<p>Published guidance is consistent that membership fails when it is designed from the publisher&#x27;s needs alone (Membership Puzzle Project, 2020). The listening phase combines a short survey of newsletter recipients and regular visitors, semi-structured interviews with readers chosen to differ in age, location and attachment to the title, and one or more open meetings. The questions concern what readers value in the coverage, what they miss, how they would want to be involved and what they would regard as a fair request. Stated willingness to pay is recorded and treated with reserve, for the reasons given above. The output is a written summary agreed by editorial and commercial staff.</p>
</sec>
<sec id="sec3-4"><title>3.3. Phase 3: Offer, hypotheses and stopping rules</title>
<p>The offer is now written down: the appeal, the price points, what members receive and what remains open to all. Alongside it the newsroom writes its hypotheses in plain terms, for example that an appeal based on the title&#x27;s civic role will convert more regular readers than one based on member benefits, or that members who attend an event will renew at a higher rate than those who do not. It also writes the rules by which it will judge the trial: the level of recurring income by a stated date that would justify continuing, the level below which the scheme would be redesigned or closed, and the editorial time it is prepared to spend. Fixing these before launch is the single most important discipline in the framework, because it prevents the result from being reinterpreted to suit the hopes of those who ran it.</p>
</sec>
<sec id="sec3-5"><title>3.4. Phase 4: Staged launch with planned comparisons</title>
<p>The launch is staged so that comparisons are possible. On the website, regular visitors can be allocated at random to alternative appeal messages, and the allocation and outcome logged. Guidance on online experiments warns against stopping a test as soon as a difference appears, against running many variants on little traffic, and against judging on clicks when the outcome of interest is payment (Kohavi et al., 2020). A regional site has limited traffic, so the newsroom should test few alternatives, each expressing a real difference in approach, and accept that small effects will not be detectable. Channels that cannot be randomised, such as a print appeal or an editor&#x27;s letter, are introduced at different times so that their effects can be distinguished in the daily series of joins.</p>
</sec>
<sec id="sec3-6"><title>3.5. Phase 5: Retention by cohort</title>
<p>A launch produces a burst of goodwill. What sustains a newsroom is renewal. Members are therefore grouped by the month in which they joined and each group is followed separately, since an overall retention figure hides the difference between early enthusiasts and later joiners. Fader and Hardie (2007) show why retention observed in the first periods of a contractual relationship should not be projected forward as a constant rate. Reasons for leaving are collected at cancellation, and participation is recorded alongside payment: attendance at events, responses to call-outs, contributions of knowledge to reporting.</p>
</sec>
<sec id="sec3-7"><title>3.6. Phase 6: Review</title>
<p>At the date fixed in Phase 3 the newsroom compares outcomes with its rules and records a decision to continue, change or stop. The review draws on the quantitative record and on a second round of interviews with members, lapsed members and staff, analysed against the case study protocol (Yin, 2018). It should state what cannot be concluded as plainly as what can.</p>
</sec>
</sec>
<sec id="sec4"><title>4. Measures and Their Interpretation</title>
<p>Four families of measure are proposed. Conversion is the proportion of the loyal audience identified in the audit who join, and not the proportion of all visitors, which flatters or condemns a scheme according to how much passing traffic the site happens to receive. Revenue is recurring income net of payment charges and the direct costs of serving members. Retention is measured by cohort as described. Participation and cost capture what makes membership different from subscription: how many members do something other than pay, and how many staff hours the relationship takes. A scheme that covers its cash cost while absorbing a reporter&#x27;s time each week has not yet been shown to sustain journalism. Readership of open content should be tracked throughout, given the evidence that payment barriers can reduce local reach (Olsen et al., 2020).</p>
</sec>
<sec id="sec5"><title>5. Safeguards</title>
<p>Two safeguards belong in the trial plan. Reader data gathered for the trial should be limited to what the measures require, held under the data protection law that applies, and used for testing only in ways readers have been told about. And the terms of membership should state that payment buys no influence over coverage. Closer relations with supporters are the purpose of the model and also its hazard, particularly in small communities where members may be the subjects of reporting (Hess and Waller, 2017).</p>
</sec>
<sec id="sec6"><title>6. Limitations and What Remains to Be Shown</title>
<p>The framework is untested. Its claim is that a newsroom following it will end with better grounds for its decision than one that does not, and that claim is itself open to examination, for instance by comparing the quality of the review documents produced by titles that adopt the framework with those of titles that launch conventionally. Several weaknesses are already apparent. A single title in a single market yields results that may not transfer, and the general lesson of the willingness-to-pay literature is that context matters a great deal (O&#x27;Brien et al., 2020). Traffic on regional sites limits what randomised tests can detect. The staggered introduction of channels gives only quasi-experimental evidence and is exposed to coincident events, such as a major local story, which the review must weigh (Shadish et al., 2002). Finally, the framework asks for record-keeping that a depleted newsroom may find hard to maintain, and the burden should be judged honestly in Phase 1.</p>
</sec>
<sec id="sec7"><title>7. Conclusion</title>
<p>Membership is asked to carry a great deal of hope in regional journalism. The framework proposed here does not make it more likely to succeed. It makes success or failure legible, by fixing a baseline, listening before designing, committing to rules before launch, staging the launch so that alternatives can be compared, following members beyond the first payment, and reviewing against what was written down. Whether newsrooms can apply it under the pressures they face is a question for those who try, and their documented experience would be a useful addition to a literature that still has more advocacy than evidence.</p>
</sec>
<sec id="sec8"><title>Conflict of interest</title>
<p>To be declared by the author(s) before publication.</p>
</sec>
<sec id="sec9"><title>Funding</title>
<p>To be declared by the author(s) before publication.</p>
</sec>
</body>
<back>
<ref-list><title>References</title>
<ref id="ref1"><label>1</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Abernathy, P.M.</string-name></person-group> (<year>2018</year>). <article-title>The Expanding News Desert</article-title>. <source>Center for Innovation and Sustainability in Local Media, University of North Carolina, Chapel Hill</source></mixed-citation></ref>
<ref id="ref2"><label>2</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Chyi, H.I.</string-name></person-group> (<year>2012</year>). <article-title>Paying for what? How much? And why (not)? Predictors of paying intent for multiplatform newspapers</article-title>. <source>International Journal on Media Management</source>, <volume>14(3)</volume>, <fpage>227-250</fpage></mixed-citation></ref>
<ref id="ref3"><label>3</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Chyi, H.I. and Ng, Y.M.M.</string-name></person-group> (<year>2020</year>). <article-title>Still unwilling to pay: An empirical analysis of 50 U.S. newspapers&#x27; digital subscription results</article-title>. <source>Digital Journalism</source>, <volume>8(4)</volume>, <fpage>526-547</fpage></mixed-citation></ref>
<ref id="ref4"><label>4</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Fader, P.S. and Hardie, B.G.S.</string-name></person-group> (<year>2007</year>). <article-title>How to project customer retention</article-title>. <source>Journal of Interactive Marketing</source>, <volume>21(1)</volume>, <fpage>76-90</fpage></mixed-citation></ref>
<ref id="ref5"><label>5</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Fletcher, R. and Nielsen, R.K.</string-name></person-group> (<year>2017</year>). <article-title>Paying for online news: A comparative analysis of six countries</article-title>. <source>Digital Journalism</source>, <volume>5(9)</volume>, <fpage>1173-1191</fpage> <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/21670811.2016.1246373">https://doi.org/10.1080/21670811.2016.1246373</ext-link></mixed-citation></ref>
<ref id="ref6"><label>6</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Hansen, E. and Goligoski, E.</string-name></person-group> (<year>2018</year>). <article-title>Guide to Audience Revenue and Engagement</article-title>. <source>Tow Center for Digital Journalism, Columbia University, New York</source></mixed-citation></ref>
<ref id="ref7"><label>7</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Hess, K. and Waller, L.</string-name></person-group> (<year>2017</year>). <article-title>Local Journalism in a Digital World</article-title>. <source>Palgrave, London</source></mixed-citation></ref>
<ref id="ref8"><label>8</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Kohavi, R., Tang, D. and Xu, Y.</string-name></person-group> (<year>2020</year>). <article-title>Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing</article-title>. <source>Cambridge University Press, Cambridge</source></mixed-citation></ref>
<ref id="ref9"><label>9</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Lewis, S.C., Holton, A.E. and Coddington, M.</string-name></person-group> (<year>2014</year>). <article-title>Reciprocal journalism: A concept of mutual exchange between journalists and audiences</article-title>. <source>Journalism Practice</source>, <volume>8(2)</volume>, <fpage>229-241</fpage> <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/17512786.2013.859840">https://doi.org/10.1080/17512786.2013.859840</ext-link></mixed-citation></ref>
<ref id="ref10"><label>10</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Membership Puzzle Project</string-name></person-group> (<year>2020</year>). <article-title>The Membership Guide</article-title>. <source>Membership Puzzle Project, New York University, New York</source></mixed-citation></ref>
<ref id="ref11"><label>11</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Myllylahti, M.</string-name></person-group> (<year>2014</year>). <article-title>Newspaper paywalls – the hype and the reality: A study of how paid news content impacts on media corporation revenues</article-title>. <source>Digital Journalism</source>, <volume>2(2)</volume>, <fpage>179-194</fpage></mixed-citation></ref>
<ref id="ref12"><label>12</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Nielsen, R.K. (ed.)</string-name></person-group> (<year>2015</year>). <article-title>Local Journalism: The Decline of Newspapers and the Rise of Digital Media</article-title>. <source>I.B. Tauris, London</source></mixed-citation></ref>
<ref id="ref13"><label>13</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>O&#x27;Brien, D., Wellbrock, C.-M. and Kleer, N.</string-name></person-group> (<year>2020</year>). <article-title>Content for free? Drivers of past payment, paying intent and willingness to pay for digital journalism – a systematic literature review</article-title>. <source>Digital Journalism</source>, <volume>8(5)</volume>, <fpage>643-672</fpage></mixed-citation></ref>
<ref id="ref14"><label>14</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Olsen, R.K., Kammer, A. and Solvoll, M.K.</string-name></person-group> (<year>2020</year>). <article-title>Paywalls&#x27; impact on local news websites&#x27; traffic and their civic and business implications</article-title>. <source>Journalism Studies</source>, <volume>21(2)</volume>, <fpage>197-216</fpage></mixed-citation></ref>
<ref id="ref15"><label>15</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Picard, R.G.</string-name></person-group> (<year>2011</year>). <article-title>The Economics and Financing of Media Companies, 2nd edn</article-title>. <source>Fordham University Press, New York</source></mixed-citation></ref>
<ref id="ref16"><label>16</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Pickard, V.</string-name></person-group> (<year>2020</year>). <article-title>Democracy Without Journalists?</article-title>. <source>Confronting the Misinformation Society. Oxford University Press, New York</source></mixed-citation></ref>
<ref id="ref17"><label>17</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Shadish, W.R., Cook, T.D. and Campbell, D.T.</string-name></person-group> (<year>2002</year>). <article-title>Experimental and Quasi-Experimental Designs for Generalized Causal Inference</article-title>. <source>Houghton Mifflin, Boston</source></mixed-citation></ref>
<ref id="ref18"><label>18</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name>Yin, R.K.</string-name></person-group> (<year>2018</year>). <article-title>Case Study Research and Applications: Design and Methods, 6th edn</article-title>. <source>Sage, Thousand Oaks, CA</source></mixed-citation></ref>
</ref-list>
</back>
</article>