Tag: questionnaire

  • What Response Rate Will a Business Dissertation Survey Actually Get? The Data, and the Sample Size It Leaves You (2026)

    What Response Rate Will a Business Dissertation Survey Actually Get? The Data, and the Sample Size It Leaves You (2026)

    Key finding: published management research achieves an average response rate of about 52.7% when surveying individuals and 35.7% when surveying organisations, but those figures come from funded studies with institutional backing — an unfunded undergraduate survey distributed by cold email should plan for a single-figure percentage and size its distribution list accordingly.

    The gap between those two realities is where business dissertations get into trouble. A student reads a paper reporting 48% response, assumes a list of 200 contacts will yield 96 replies, sends the survey, receives 14, and arrives at the analysis chapter with a sample too small to support the regression the proposal promised.

    No national dataset tracks response rates for UK student dissertation surveys specifically. What follows combines the published methodological literature — which is real, cited and dated — with clearly labelled practitioner estimates for the student case, so you can see which is which.

    The benchmark figures from published research

    Finding Figure Source and year
    Average response rate, individual-level surveys in organisational research 52.7% (SD 20.4) Baruch and Holtom, Human Relations, 2008 — meta-analysis of 1,607 studies
    Average response rate, surveys of organisations or senior management 35.7% (SD 18.8) Baruch and Holtom, 2008
    Decline in management survey response over two decades From 55.6% (1975) to 48.4% (1995) Baruch, Human Relations, 1999
    Web surveys compared with other modes Approximately 11 percentage points lower on average Manfreda et al., International Journal of Market Research, 2008 — meta-analysis of 45 experimental comparisons
    Response rate for an unfunded student cold-email survey Commonly 2–10% — practitioner estimate, no published dataset Not established in the literature; treat as a planning assumption

    Two things follow. First, the headline benchmarks describe surveys with resources behind them: institutional letterhead, follow-up mailings, sometimes incentives, and frequently a pre-existing relationship with respondents. Second, even within that literature, surveying managers rather than employees costs roughly 17 percentage points — a finding that should shape who you decide to survey.

    Why the published averages do not transfer to your project

    Four differences separate a published management study from an undergraduate dissertation survey.

    • Sponsorship. A survey introduced by a professor at a named business school carries authority a student email does not. Sending from your university address rather than a personal one recovers some of this, and costs nothing.
    • Follow-up. Published studies typically send two or three reminders. Dillman’s Tailored Design Method treats sequenced contact as central, and reminders routinely add more responses than the original mailing. Student surveys frequently go out once.
    • Relationship. Response rates rise sharply when a respondent has some connection to the researcher — an employer, a placement organisation, a professional network.
    • Incentives. Prize draws and small payments raise response. Most students have no budget, and any incentive must be declared to your ethics committee before you offer it.

    The practical implication is not that you should give up on survey research. It is that you should plan the arithmetic backwards from the sample you need rather than forwards from the list you happen to have.

    Working backwards: how big does your distribution list need to be?

    Start from the analysis, not the survey. Common undergraduate business analyses and the sample sizes they require:

    Planned analysis Minimum usable n Basis
    Correlation, medium effect (r = .30), 80% power, α = .05 ~84 Conventional power analysis (Cohen, 1988)
    Multiple regression, 4 predictors, medium effect ~85 Cohen’s f² = .15 at 80% power
    Multiple regression, rule-of-thumb minimum 50 + 8 × predictors Green, Multivariate Behavioral Research, 1991
    Independent-samples t-test, medium effect (d = 0.5) ~64 per group Conventional power analysis (Cohen, 1988)
    Descriptive and correlational reporting only ~50 Departmental convention; check your handbook

    Now apply attrition. Suppose you need 85 usable responses for a regression with four predictors:

    1. Usable responses needed: 85
    2. Allow for incomplete and careless responses — typically 10–20% of submissions are unusable — so target roughly 100 submissions.
    3. At a 20% response rate (realistic for a warm list — your own workplace, a placement employer, a professional association that has agreed to circulate it): distribute to about 500 people.
    4. At a 5% response rate (realistic for cold outreach to strangers): distribute to about 2,000 people.

    That final line is the one that changes projects. Very few undergraduates can assemble a genuine list of 2,000 relevant business contacts. Confronting this arithmetic in week three rather than week ten is the difference between adjusting your design and salvaging a broken one. The general logic of sizing a study — and the difference between what is statistically required and what your department actually expects — is set out in the guide to what sample size an undergraduate dissertation needs.

    Five design decisions that materially raise response

    1. Shorten it. Response falls as length rises. Under ten minutes, and preferably five. Every scale you add costs you respondents, and a smaller sample damages your analysis more than a missing variable does.
    2. Send from your university address. Institutional domains carry credibility and are less likely to be filtered as spam.
    3. Plan two reminders. Schedule them at roughly one and two weeks, and get the wording approved in your ethics application so you are not blocked later. Reminders frequently deliver as many responses as the initial send.
    4. Use a gatekeeper. One email from an HR manager to 200 staff will outperform 200 cold emails from a student by an order of magnitude. Trade body newsletters, alumni networks and LinkedIn groups with an active moderator work on the same principle.
    5. Survey employees rather than executives where the question allows. The 2008 meta-analysis puts roughly 17 percentage points between the two. If your research question can be answered at individual level, answer it there.

    What to do when the responses do not arrive

    If you are three weeks in with 22 responses, you have four options and they are not equally good.

    Option 1: extend and broaden the sampling frame. Best if time allows. Note that widening from one sector to several changes your population, and you must say so in your methodology and limitations.

    Option 2: change the analysis to match the sample. Perfectly legitimate. A well-executed correlational study with n = 45 beats an underpowered five-predictor regression with n = 38. Report descriptive statistics, correlations and effect sizes with confidence intervals, and state explicitly that the study was underpowered for multivariate analysis.

    Option 3: convert to a qualitative or mixed design. Eight to twelve semi-structured interviews can answer many business research questions better than a thin survey. This normally requires an ethics amendment, so speak to your supervisor before switching.

    Option 4: use secondary data. Frequently the strongest rescue for business projects, because the datasets are large, free and already cleaned — company financials, ONS business statistics, sector reports. The subject-by-subject list in the guide to free UK data sources for a dissertation is the fastest place to look for a viable replacement.

    What you must not do is quietly proceed with the underpowered analysis and hope nobody checks. Markers do check, and an unacknowledged n = 31 regression with six predictors reads as a student who does not understand their own method.

    Reporting response rate in your methodology chapter

    State four numbers, in this order: how many people the survey was distributed to, how many responses were received, how many were retained after cleaning, and the resulting response rate as a percentage. Then say how that compares with published benchmarks.

    A worked example: “The questionnaire was distributed to 480 employees across three retail organisations. 96 responses were received, of which 87 were retained after removing incomplete submissions and two cases failing the attention check, giving an effective response rate of 18.1%. This falls below the 52.7% average reported by Baruch and Holtom (2008) for individual-level organisational research, which is consistent with the absence of institutional sponsorship and incentives in the present study.”

    That paragraph does something important: it pre-empts the criticism by naming it. Markers reward a student who identifies the weakness in their own data before the examiner does. The same reflective habit shapes the whole chapter, and the structure expected of it is covered in the guide to writing the methodology chapter of a business or management dissertation.

    Non-response bias: the paragraph almost everyone omits

    Low response is a problem chiefly because of who does not respond. If dissatisfied employees ignore your engagement survey, your results are biased upward regardless of sample size.

    You cannot eliminate this, but you can address it credibly in two ways. Compare your sample’s demographics against the known population — if your organisation is 60% female and your sample is 61%, say so, as it is weak but real evidence of representativeness. And compare early with late respondents, since late respondents are conventionally treated as proxies for non-respondents; if their scores do not differ significantly, that is reportable evidence.

    One short paragraph doing this demonstrates methodological awareness that most undergraduate dissertations lack.

    Before you analyse: check the data will support the test

    A small sample makes assumption violations both more likely and more consequential. Normality tests behave erratically at low n, outliers exert more leverage, and a single careless respondent can move a correlation noticeably. Screen the data before running anything, and if the assumptions do not hold, the options for proceeding honestly are set out in the guide on what to do when your statistical assumptions fail.

    One further practical point: run your survey on a platform your university has approved, since data collected on an unapproved consumer tool can fail institutional UK GDPR requirements and occasionally cannot be used at all. The options available to UK students are compared in the review of survey platforms you can actually use for a student dissertation.

    Turn the numbers into a written chapter

    Once your responses are in, the methodology and results chapters are largely a matter of reporting the figures in the expected order. Tesify can take your distribution figures, response counts and analysis plan and draft the sampling, response rate and data screening sections in the structure markers expect, with citations formatted as you go. The design decisions and the interpretation stay yours — the drafting stops eating the week.

    Frequently asked questions

    What counts as an acceptable response rate for a business dissertation?

    There is no fixed threshold at undergraduate level. What is marked is whether you report the rate transparently, compare it against published benchmarks, and discuss non-response bias. A 12% rate reported honestly scores better than a 40% rate reported without context.

    Can I calculate a response rate if I posted the survey on social media?

    Not a true one, because you cannot know how many people saw it. Report it as a convenience sample, give the number of responses and the platforms used, and state plainly that a response rate cannot be calculated for an open link.

    How many responses do I need for a regression with five predictors?

    Green’s rule of thumb gives 50 + 8 × 5 = 90 as a minimum. Formal power analysis for a medium effect at 80% power gives a similar figure. Below about 70 the estimates become unstable and you should reduce the number of predictors.

    Is it acceptable to survey my own workplace?

    Yes, and it usually produces far better response rates, but it raises ethical issues around coercion and anonymity that your ethics committee will want addressed. You will normally need written permission from the organisation as a gatekeeper.

    Should I offer a prize draw to boost responses?

    Only with prior ethical approval. Incentives must be proportionate, must not be coercive, and require a lawful basis for collecting the contact details needed to administer the draw — which usually means separating those details from the survey responses.

    Do reminder emails actually work?

    Yes, substantially. Sequenced follow-up is central to Dillman’s Tailored Design Method, and in many studies reminders generate a comparable number of responses to the initial contact. Get the reminder wording approved in your original ethics application so you can send it without delay.

  • What Is an Acceptable Cronbach’s Alpha for a Dissertation? (2026)

    What Is an Acceptable Cronbach’s Alpha for a Dissertation? (2026)

    There is no single acceptable value. The convention is that alpha of .70 or above is adequate, but that figure comes from Nunnally’s advice for the early stages of research; he recommended .80 for basic research and .90 as a minimum where important decisions rest on individual scores. For an undergraduate dissertation using an established scale, .70 to .95 is the defensible range — and you must interpret the number, not just report it.

    That is the honest answer, and it is more useful than a threshold, because markers rarely penalise a modest alpha that has been discussed intelligently and frequently penalise a high one that has been pasted in without comment. Here is what the coefficient is doing, what it cannot do, and how to write it up.

    What does Cronbach’s alpha actually measure?

    It estimates internal consistency: the extent to which the items in one scale correlate with each other, and so appear to be tapping the same underlying construct. If your six questions about workplace stress genuinely hang together, people who score high on one will tend to score high on the others, and alpha will be high.

    Two things follow that students routinely get wrong. Alpha is a property of the scores from your sample, not a permanent property of the instrument — which is why you report your own alpha even for a well-established scale rather than quoting the original authors’. And alpha is about consistency, not accuracy: a scale can be highly consistent and consistently measure the wrong thing.

    Where did the .70 rule come from, and what did Nunnally really say?

    Almost every dissertation that justifies a threshold cites Jum Nunnally’s Psychometric Theory (2nd edition, 1978). Very few quote him. He wrote, at pages 245–246:

    “what a satisfactory level of reliability is depends on how a measure is being used. In the early stages of research … one saves time and energy by working with instruments that have only modest reliability, for which purpose reliabilities of .70 or higher will suffice. … In contrast to the standards in basic research, in many applied settings a reliability of .80 is not nearly high enough. In basic research, the concern is with the size of correlations and with the differences in means for different experimental treatments, for which purposes a reliability of .80 for the different measures is adequate. In many applied problems, a great deal hinges on the exact score made by a person on a test. … In those applied settings where important decisions are made with respect to specific test scores, a reliability of .90 is the minimum that should be tolerated, and a reliability of .95 should be considered the desirable standard.”

    Read that in full and the familiar rule inverts. Nunnally offers .70 as a concession for exploratory work, treats .80 as the ordinary standard for basic research, and reserves his real severity for applied decisions. The point he was making is that .70 is not usually sufficient and that we should be working to a considerably higher standard most of the time.

    This misreading is not a private observation. Lance, Butts and Michels traced four widely repeated cutoff criteria back to their original sources in Organizational Research Methods (2006, volume 9, issue 2, pages 202–220) and found that the sources did not say what they are routinely cited as saying. Citing “Nunnally (1978)” for a flat .70 threshold is citing a source against its own argument — and it is the kind of thing a well-read marker enjoys pointing out.

    The practical move for your dissertation is not to panic but to be precise: state the value you obtained, say what standard you are judging it against and why that standard fits your purpose, and cite honestly.

    Does a higher alpha always mean a better scale?

    No, and this is the second thing markers look for. Alpha is a function of the average correlation between items and the number of items. Add more items saying roughly the same thing and alpha rises even if the average inter-item correlation stays modest — a point Cortina made directly in Journal of Applied Psychology (1993, volume 78, issue 1, pages 98–104).

    So a twenty-item scale reporting alpha of .92 may be less impressive than a five-item scale reporting .78. And a very high alpha, above roughly .95, is usually a warning rather than a triumph: it suggests item redundancy, that you have asked the same question five times in slightly different words. Redundant items lengthen your questionnaire, increase drop-out, and add nothing.

    Alpha Conventional description What to actually think
    Below .60 Unacceptable Do not compute a total score from these items; investigate why
    .60–.69 Questionable Reportable with discussion; treat findings from the scale cautiously
    .70–.79 Acceptable Fine for exploratory undergraduate work; Nunnally’s floor, not his standard
    .80–.89 Good The ordinary target for a basic-research design
    .90–.94 Excellent Required where decisions about individuals rest on the score
    .95 and above “Better still” Check for redundant items before celebrating

    Descriptive labels like these circulate widely and vary between textbooks. Taber’s review of how alpha is used and described in science education research (Research in Science Education, 2018, volume 48, issue 6, pages 1273–1296) documents just how inconsistently the same numbers get labelled across published studies. Use the table as orientation, and let your discussion, not the adjective, carry the argument.

    A printed Likert-scale questionnaire being completed by a participant
    Alpha describes how your respondents answered these items — not a fixed property of the questionnaire itself.

    Does a good alpha prove my scale measures one thing?

    No. This is the most consequential misunderstanding of the coefficient. Alpha is not a test of unidimensionality, and a multidimensional set of items can produce a perfectly respectable alpha. If your scale has established subscales, compute alpha separately for each subscale as well as for the total, and say so. Demonstrating that items form a single dimension requires factor analysis, not a reliability coefficient.

    Should I delete items to raise my alpha?

    Sometimes, carefully, and always transparently. Your reliability output gives you two diagnostics: the corrected item-total correlation, which is the correlation between each item and the scale score computed without that item, and the alpha-if-item-deleted value. An item with a very low corrected item-total correlation, whose removal raises alpha above the full-scale value, is a genuine candidate for deletion.

    Three cautions. Check first that you reverse-scored every negatively worded item before running the analysis — a forgotten reverse-score is the most common cause of a mysteriously terrible alpha and of one item that looks catastrophic on its own. Do not strip a validated scale down to whatever maximises alpha, because you then no longer have the instrument you cited and cannot claim its published validity evidence. And report every deletion, with the reason and both alpha values, rather than quietly presenting the improved figure.

    What should I do if my alpha is low?

    Diagnose before you despair. Reverse-scoring errors come first. Then check whether one item was ambiguously worded or interpreted differently by your participants, whether the scale was written for a different population from yours, and whether your sample is simply small — alpha estimated from thirty responses is unstable, and your justification for that number should already be in your methods, as we set out in our guide to sample size for an undergraduate dissertation.

    If it stays low, report it and discuss it. Low reliability attenuates correlations, pulling them towards zero, which means it makes you less likely to find a significant relationship rather than more — so a low alpha alongside a non-significant result is a limitation worth stating explicitly, because it is a plausible reason the effect did not appear. A limitations section that identifies that mechanism reads as competence. A silently reported .54 reads as something else.

    A published scale's item list being checked against a dissertation questionnaire
    If you shortened or reworded a validated scale, its published reliability evidence no longer transfers — you are reporting on a new instrument.

    Should I use McDonald’s omega instead?

    There is a real methodological argument that you should. Alpha rests on assumptions — notably that all items relate equally strongly to the underlying construct — that real scales frequently violate, and McDonald’s omega relaxes them. Hayes and Coutts made the case directly in a paper titled “Use Omega Rather than Cronbach’s Alpha for Estimating Reliability. But…” (Communication Methods and Measures, 2020, volume 14, issue 1, pages 1–24), and the trailing “But…” is doing real work: they qualify the recommendation rather than issuing it flatly.

    For an undergraduate dissertation the sensible position is that alpha remains the expected convention and is what most UK departments teach. Report omega alongside it if your software gives it to you easily and you can explain what it is; do not substitute a coefficient you cannot define. A marker asking “why omega?” and receiving a confident answer is a good moment. Receiving silence is not.

    How do I report alpha in my dissertation?

    In the methods chapter, name the scale, its source, the number of items and the response format. In the results, give alpha for your own sample to two decimal places, with a leading zero omitted in APA style: α = .84. Report each subscale separately where subscales exist. If you deleted items, say which and why, and give alpha before and after.

    A worked sentence you can adapt: “Internal consistency for the six-item scale was good in the present sample (α = .84), comparable to the .87 reported by the scale’s authors. One item was retained despite a low corrected item-total correlation (.19) because removing it would have departed from the validated instrument; alpha excluding that item would have been .88.”

    That sentence does everything a marker wants: it reports, it compares, it makes a decision, and it justifies the decision. The wider architecture it sits inside — design, sampling, instruments, analysis — is set out in our guide to writing a methodology chapter, and the reliability run itself is a couple of clicks in whichever package your course uses, compared in SPSS vs R vs jamovi.

    Reliability is only half the picture, too. Once you know your scale is consistent, the analysis question is which test its scores belong in — see choosing the right statistical test. If your project turned out to be qualitative instead, reliability coefficients do not transfer at all; the equivalent quality debate is covered in our guide to doing a thematic analysis.

    When the analysis is settled and the writing is the bottleneck, Tesify can structure and draft your dissertation around your own results — every word still written by you, with the structure and bibliography handled.

    Frequently asked questions

    Is 0.7 a good Cronbach’s alpha?

    It is conventionally described as acceptable, and it is adequate for exploratory undergraduate work. But .70 was Nunnally’s figure for the early stages of research, not his general standard — he treated .80 as adequate for basic research. Report .70 with a sentence of discussion rather than presenting it as a pass mark.

    What if my Cronbach’s alpha is 0.6?

    Report it, investigate it and discuss it. Check reverse-scoring first, then item wording and sample size. You can still use the scale if you are explicit about the limitation and cautious in your conclusions, and the attenuation argument gives you something intelligent to say about any non-significant results.

    Can Cronbach’s alpha be too high?

    Yes. Above about .95 the usual cause is redundant items asking the same question repeatedly. That is a design weakness rather than a strength, and it is worth a line in your discussion.

    Do I report alpha for the whole scale or each subscale?

    Both, when the instrument has established subscales. A respectable total-scale alpha can hide a weak subscale, and reporting only the total looks like concealment even when it is not.

    Do I need to calculate alpha if I used a published validated scale?

    Yes. Alpha describes your data, not the instrument in the abstract, and reliability varies by sample and population. Report your own value and compare it with the published one — a sentence that does both is stronger than either alone.

    Can I use Cronbach’s alpha with a two-item scale?

    It is not informative with two items. Report the correlation between the two items instead, and say why. Alpha’s dependence on item count makes it a poor summary for very short scales.

    Does alpha apply to a scale I wrote myself?

    You can compute it, but a good alpha on a self-written scale demonstrates only internal consistency, not that the scale measures what you claim. Expect a marker to ask about validity, and prefer an established instrument wherever one exists.

    Is Cronbach’s alpha the same as validity?

    No. Reliability is consistency; validity is whether the instrument measures the intended construct. A scale can be reliably wrong. Your methods chapter should address both, and they need different evidence.

    Do I need alpha for a single-item measure?

    No — internal consistency has no meaning for one item. Single-item measures are acceptable for some constructs, such as a straightforward demographic or a global rating, but you should say why one item was sufficient.

    How do I write alpha in APA style?

    Use the Greek letter with no leading zero, italicised, to two decimal places: α = .84. Put it in the results text or in a table of scale statistics, and keep the format consistent throughout the dissertation.