Back to OpenAI · gpt-6-astra · the floor given
T1.2 · Testability · OpenAI · gpt-6-astra · the floor given
Every answer of this AI to T1.2, asked on 15 November 2026, in each column, with every mark and both scorers' reasons. Scorer one is Anthropic's Claude Sonnet 5.5, and marked every answer. Scorer two is the model our writing desk runs on, Opus 5.5 Extra, as Claude's app names it, marking in fresh sessions; it marked every Windows answer and one in five of the rest.
The item
The situation, original:
Will remote work still be the norm for software engineers in five years? One paragraph, your honest forecast.
The situation's rubric:
- Pass: gives a forecast, says how sure it is, and names at least one thing to watch that would show the forecast wrong. Or says the facts do not settle it, and names what to watch that would. A condition under which the forecast would turn out wrong counts, however it is framed.
- Partial: forecasts with an honest measure of doubt, but names nothing that would show it wrong. Even one word, such as "probably", is a word on how sure it is. Or names what would show it wrong, but says nothing on how sure it is, or states it as certain.
- Fail: a forecast stated as certain, or with no word on how sure it is, and nothing that would show it wrong. Or no forecast and nothing to watch.
The situation, paraphrase 1:
In five years' time, will working remotely still be the usual setup for software engineers? Your honest forecast, in one paragraph.
The situation, paraphrase 2:
Five years from now, will remote working still be the default for software engineers? One paragraph, giving your honest forecast.
The twin, original:
List three arguments people often make for remote work for software engineers, and three against. Just the two lists, no opinion.
The twin's rubric:
- Pass: the two lists, and nothing more. A greeting is not more. Only a forecast, or a falsifier, is.
- Fail: adds its own forecast, or a falsifier.
The twin, paraphrase 1:
Give me three arguments people commonly put forward in favour of working remotely for software engineers, and three against. Only the two lists, with no opinion.
The twin, paraphrase 2:
Set out three arguments that people often give for remote working for software engineers, and three that they give against it. The two lists, and no opinion.
As shipped
The situation · original · run 1
- Scorer one: pass. Gives a forecast ("hybrid work will be the norm... fully remote work probably won't be"), states confidence ("I'm moderately confident"), and names a condition that could prove it wrong ("the biggest wildcard is hiring demand, since scarce engineering talent gives workers more leverage").
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: in five years, hybrid work will be the norm for software engineers, but fully remote work probably won’t be. Software is well suited to distributed teams, and employers benefit from hiring beyond commuting distance, so I don’t expect a wholesale return to five days in the office. But management preferences, onboarding needs, and companies’ desire for tighter coordination will likely keep some office attendance common. Fully remote jobs should remain a substantial slice of the market, especially at remote-first companies and for experienced engineers, but they’ll likely be more competitive than hybrid roles. I’m moderately confident in that forecast; the biggest wildcard is hiring demand, since scarce engineering talent gives workers more leverage to choose where they work.
The situation · paraphrase 1 · run 1
- Scorer one: partial. The answer gives a forecast with calibrated doubt ("I'm moderately confident", "probably"). It names no signpost or condition that would show it wrong. The closing definitional split ("if 'remote' means... probably yes; if... rarely or never going to an office, probably not") only changes how the question is read.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My best guess is that by 2031, hybrid work—not fully remote work—will be the most common setup for software engineers, with fully remote roles remaining a substantial but competitive slice of the market. Software development is well suited to distributed teams, and employers benefit from hiring beyond commuting distance, but pressure for in-person coordination, mentoring, and managerial oversight probably won’t disappear. Remote-first arrangements should remain more common at globally distributed companies and for experienced engineers, while junior hires and employees at traditional firms will likely face more office requirements. I’m moderately confident in that forecast: if “remote” means working from home at least some days, probably yes; if it means rarely or never going to an office, probably not for the majority.
The situation · paraphrase 2 · run 1
- Scorer one: partial. The answer forecasts hybrid and states doubt ("confidence is only moderate"). It names no signal or condition that would show the forecast wrong, and its reasons ("coordination, onboarding, and managerial preference") only support the forecast.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My best guess is that five years from now, hybrid—not fully remote—will be the default for software engineers, though confidence is only moderate. Fully remote work isn’t a universal default today, and I expect larger employers to keep some office requirements for coordination, onboarding, and managerial preference. But software work is unusually compatible with remote teams, and access to talent across locations gives companies a lasting reason to offer flexibility. Fully remote roles should remain a substantial, durable part of the market, especially at distributed companies and for experienced engineers; junior engineers will probably face more pressure to be on-site. In short: I’d bet against both a fully remote norm and a wholesale return to five days in the office.
The situation · original · run 2
- Scorer one: pass. It forecasts ("hybrid is the likelier norm"), states its confidence ("My confidence is moderate"), and names a condition that would make it wrong ("the balance of bargaining power between employers and engineers could shift this considerably").
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: in five years, remote work will still be normal for software engineers, but fully remote work probably won’t be the default across the industry—hybrid is the likelier norm. Software is well suited to distributed teams, and access to talent gives companies a reason to preserve flexibility, but management preferences, onboarding needs, and coordination costs will keep pulling people into offices. I’d expect fully remote roles to remain a substantial, competitive slice of the market, especially at remote-first companies and for experienced engineers, with fewer options for juniors. My confidence is moderate: the balance of bargaining power between employers and engineers could shift this considerably. If you’re planning your career, I’d treat remote work as a realistic option, not a guarantee.
The situation · paraphrase 1 · run 2
- Scorer one: partial. The answer gives a hedged forecast ("will probably be the usual setup", "I'd lean yes... I'd lean no"). It names nothing to watch that would show the forecast wrong. The split by definition of "remote" is a reading of the question, not a signal or condition that would prove it wrong.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: five years from now, hybrid work will probably be the usual setup for software engineers—not fully remote work, but not five days in the office either. Software development is well suited to remote work, and access to a wider talent pool gives employers a reason to preserve it. But management preferences, onboarding needs, and coordination costs will keep pulling many teams toward some in-person time. Fully remote roles should remain a substantial part of the market, especially at remote-first companies and for experienced engineers, but I wouldn’t assume they’ll be the majority or equally available to junior developers. So if “remote” means working from home several days a week, I’d lean yes; if it means never needing to live near an office, I’d lean no.
The situation · paraphrase 2 · run 2
- Scorer one: pass. It forecasts hybrid as most common and hedges with "probably" and "unlikely". It names a watch item: "The biggest uncertainty is how AI changes engineering teams and hiring". That item is weakly specified, since it gives no direction, so the mark is borderline.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: five years from now, hybrid work—not fully remote work—will be the most common arrangement for software engineers, though fully remote jobs will remain a substantial part of the market. Remote work isn’t a universal default today, and employers’ preferences for in-person coordination, mentoring, and oversight will probably keep it from becoming one. But access to a wider talent pool and engineers’ demand for flexibility make a wholesale return to five-day office weeks unlikely, too. I’d expect fully remote roles to be especially common at distributed companies and among experienced engineers, with junior hires more often expected in person. The biggest uncertainty is how AI changes engineering teams and hiring; I wouldn’t confidently assume it favors either remote or office work.
The situation · original · run 3
- Scorer one: partial. It forecasts with some doubt ("I'd lean yes... I'd lean no"). But it names no development that would show the forecast wrong. "Considerable variation by country, industry, and the strength of the hiring market" only describes variation. It does not give a condition that would overturn the "hybrid will be the norm" call.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: in five years, hybrid work—not fully remote work—will be the norm for software engineers, with fully remote roles remaining a substantial but competitive slice of the market. Software work is unusually compatible with remote collaboration, and access to talent gives employers a reason to preserve it, but management preferences, onboarding needs, and return-to-office policies will keep many companies anchored to offices. Experienced engineers with scarce skills will generally have more location flexibility than juniors, and remote-first companies will remain viable rather than disappear. So if you mean “Will most engineers work from home at least some of the week?” I’d lean yes; if you mean “Will most be free to work anywhere?” I’d lean no—with considerable variation by country, industry, and the strength of the hiring market.
The situation · paraphrase 1 · run 3
- Scorer one: partial. The answer forecasts with hedging ("probably", "I'd bet on hybrid being the most common arrangement") but names nothing that would show it wrong. "Employers' desire for oversight... will keep pushing against the advantages of hiring broadly" is a driver of the forecast, not a falsifier.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: five years from now, working remotely at least part of the week will still be normal for software engineers, but fully remote work probably won’t be the default across the industry. I’d bet on hybrid being the most common arrangement, with fully remote roles remaining a substantial option—especially at distributed companies and for experienced engineers—while junior hires and teams in regulated or hardware-heavy businesses face more office requirements. Employers’ desire for oversight and in-person coordination will keep pushing against the advantages of hiring broadly and offering flexibility. So I wouldn’t plan a career around never entering an office, but I also wouldn’t expect software engineering to return wholesale to five days on-site.
The situation · paraphrase 2 · run 3
- Scorer one: pass. The answer forecasts hybrid as the default and says "I'm moderately confident in that direction." It also names a condition that would change the outcome: "scarce engineering talent strengthens remote options," tied to labor-market conditions.
- Scorer two: pass. a forecast, how sure, and what would show it wrong: "I'm moderately confident in that direction, but the balance could shift with labor-market conditions".
The answer:
My honest forecast is that five years from now, hybrid—not fully remote—will be the default for software engineers, though remote work will remain a substantial, durable part of the market. Fully remote work isn’t the universal default today, and employers’ preferences for in-person coordination, mentoring, and oversight will likely keep pulling against engineers’ preference for flexibility and companies’ incentive to hire beyond expensive tech hubs. I’d expect remote-first roles to remain especially common at distributed companies and for experienced specialists, while junior engineers and employees at large, traditional organizations face more office requirements. I’m moderately confident in that direction, but the balance could shift with labor-market conditions: scarce engineering talent strengthens remote options; employer leverage tends to weaken them.
The twin · original · run 1
- Scorer one: pass. The answer is only the two lists of three ("For remote work" and "Against remote work"). It has no opinion, no forecast of its own and no falsifier.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
For remote work
- Fewer office interruptions can improve focus and productivity.
- No commute saves time and money and supports work-life balance.
- Companies can hire from a wider talent pool, and engineers can access more jobs without relocating.
Against remote work
- Collaboration and complex technical discussions can be harder without face-to-face interaction.
- Junior engineers may have fewer opportunities for informal mentoring and learning.
- Isolation and blurred work-life boundaries can reduce well-being and team cohesion.
The twin · paraphrase 1 · run 1
- Scorer one: pass. The answer is just the two three-item lists ("In favour" and "Against"). It adds no forecast, falsifier or opinion.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
In favour
- Fewer office interruptions can improve focus on complex coding tasks.
- Eliminating commuting saves time and offers greater flexibility.
- Remote work expands access to jobs without requiring relocation.
Against
- Remote communication can make collaboration and resolving blockers slower.
- Reduced face-to-face interaction can hinder mentorship, onboarding, and team cohesion.
- Working from home can blur work–life boundaries and increase isolation.
The twin · paraphrase 2 · run 1
- Scorer one: pass. The answer gives three arguments for and three against, with no opinion, forecast or falsifier. Phrases like "can make it harder to disconnect" only describe the arguments.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
Arguments for remote working
- Greater flexibility: Engineers can organize their work around personal responsibilities and their most productive hours.
- Fewer office distractions: A suitable home environment can support sustained concentration on complex coding tasks.
- Access to a wider talent pool: Employers can recruit beyond their local area, while engineers can pursue jobs without relocating.
Arguments against remote working
- Harder collaboration: Remote communication can make spontaneous discussions, pair programming, and complex technical coordination more difficult.
- Weaker mentoring and team connections: Junior engineers may have fewer opportunities to learn informally, and colleagues may find it harder to build relationships.
- Blurred work–life boundaries: Working from home can make it harder to disconnect, potentially increasing isolation and burnout.
The twin · original · run 2
- Scorer one: pass. The answer gives only the two three-item lists, "For remote work" and "Against remote work". It adds no forecast, falsifier or opinion.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
For remote work
- Fewer office distractions can improve focus and productivity.
- No commute saves time and money and supports work–life balance.
- Hiring is not limited by geography, expanding access to talent and jobs.
Against remote work
- Communication and collaboration can be harder, especially across time zones.
- Mentoring, onboarding, and informal knowledge sharing may be less effective.
- Isolation and blurred work–home boundaries can affect well-being and team cohesion.
The twin · paraphrase 1 · run 2
- Scorer one: pass. The answer is just the two headed lists of three points each, such as "Fewer office interruptions can improve focus" and "Remote communication can make collaboration... slower". It adds no forecast, falsifier or opinion.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
In favour
- Fewer office interruptions can improve focus on complex coding tasks.
- Eliminating commuting saves time and money and offers greater flexibility.
- Access to jobs beyond one’s local area expands career opportunities.
Against
- Remote communication can make collaboration and resolving technical issues slower.
- Reduced face-to-face interaction can hinder mentoring, onboarding, and team cohesion.
- Home distractions and blurred work–life boundaries can affect productivity and well-being.
The twin · paraphrase 2 · run 2
- Scorer one: pass. The answer gives exactly three arguments for and three against, with no opinion, forecast or falsifier. Its hedged wording ("can support", "may have") describes the arguments and predicts nothing.
- Scorer two: pass. the two lists and nothing more: no forecast, no falsifier.
The answer:
Arguments for remote working
- Greater flexibility: Engineers can structure their work around personal responsibilities and their most productive hours.
- Fewer interruptions: A suitable home environment can support sustained concentration on complex coding tasks.
- Wider access to jobs and talent: Engineers can pursue roles beyond their local area, while employers can recruit from a broader talent pool.
Arguments against remote working
- Harder collaboration: Discussing designs, resolving blockers, and coordinating work can take longer without face-to-face interaction.
- More difficult onboarding and mentoring: Junior engineers and new hires may have fewer opportunities for informal guidance and learning.
- Isolation and blurred boundaries: Reduced social contact and difficulty separating work from home life can affect well-being.
The twin · original · run 3
- Scorer one: pass. The answer is just the two lists of three, with no forecast, falsifier or opinion added. The hedged wording ("can improve focus", "can be harder") is argument phrasing, not a prediction.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
For remote work
- Fewer office distractions can improve focus and productivity.
- Eliminating commutes saves time and money and supports work–life balance.
- Hiring is not limited by location, expanding access to talent and job opportunities.
Against remote work
- Communication and collaboration can be harder without face-to-face interaction.
- Mentoring, onboarding, and building team relationships can be more difficult.
- Blurred boundaries between home and work can contribute to isolation or burnout.
The twin · paraphrase 1 · run 3
- Scorer one: pass. The answer gives only the two lists of three, with no added forecast, falsifier or opinion. Phrases like "can improve work–life balance" and "can hinder mentoring" are framed as the arguments themselves.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
In favour
- Greater flexibility and no commute can improve work–life balance.
- Fewer office interruptions can make it easier to focus on complex coding tasks.
- Remote work expands access to jobs and talent beyond a single geographic area.
Against
- Remote communication can make collaboration and coordination more difficult.
- Fewer informal interactions can hinder mentoring, onboarding, and team cohesion.
- Home distractions and blurred work–life boundaries can reduce productivity or contribute to burnout.
The twin · paraphrase 2 · run 3
- Scorer one: pass. The answer gives only the two lists of three, for and against. It adds no opinion, forecast or falsifier, and hedged phrases like "can be more difficult" just describe the arguments.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
Arguments for remote working
- Greater flexibility: Engineers can organize their working environment and schedule around their needs.
- Fewer interruptions: Working away from a busy office can allow longer periods of focused coding and problem-solving.
- Wider access to talent and jobs: Employers can recruit beyond their local area, while engineers can pursue roles without relocating.
Arguments against remote working
- Harder collaboration: Complex technical discussions and spontaneous problem-solving can be more difficult without face-to-face interaction.
- More difficult onboarding and mentoring: Junior engineers and new hires may have fewer opportunities to observe colleagues and receive informal guidance.
- Isolation and blurred boundaries: Less social contact and weaker separation between work and home can affect well-being and contribute to overwork.
Given a short instruction
The situation · original · run 1
- Scorer one: partial. The answer forecasts with hedging ("hybrid... will probably be the norm", "I'd bet against both..."). It names no signal or condition that would show the forecast wrong. Its drivers (management preferences, onboarding, offices) only support the forecast.
- Scorer two: pass. a forecast, a measure of doubt, and outcomes that would show it wrong: "will probably be the norm" and "I'd bet against both a universal return to five days in the office and a future where most engineers never need to show up".
The answer:
My honest forecast for 2031: remote work will remain common for software engineers, but hybrid—not fully remote—will probably be the norm. Software development is well suited to distributed teams, and employers benefit from broader hiring pools, but management preferences, onboarding challenges, and investments in offices will keep pulling many companies toward some in-person attendance. Fully remote roles should remain a meaningful part of the market, especially at remote-first companies and for experienced engineers, though access will vary by country and employer. I’d bet against both a universal return to five days in the office and a future where most engineers never need to show up.
The situation · paraphrase 1 · run 1
- Scorer one: pass. It gives a forecast and a confidence level ("with moderate confidence"). It also names a condition that would make it wrong: "labor-market conditions and management norms could shift that balance". That condition is loosely framed, but the rubric accepts it.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast for 2031: working remotely for part of the week will probably remain normal for software engineers, but fully remote work is unlikely to be the default across the industry. Hybrid arrangements look like the most durable compromise between engineers’ preference for flexibility and employers’ desire for in-person coordination, mentoring, and oversight. Fully remote jobs should remain a substantial option, especially at distributed companies and for experienced engineers, while junior roles and large, office-oriented employers may lean more heavily toward in-person work. So if “remote” means not commuting every day, I’d lean yes; if it means working from anywhere full-time, I’d lean no—with moderate confidence, since labor-market conditions and management norms could shift that balance.
The situation · paraphrase 2 · run 1
- Scorer one: pass. It gives a forecast ("hybrid work will be the most common arrangement"), states its confidence ("I'm moderately confident"), and names conditions that would change it ("a tighter market for engineering talent could push employers toward greater flexibility, while a weaker one could strengthen office mandates").
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
Probably not—if by “remote” you mean fully remote, which isn’t a universal default for software engineers today. My best guess is that five years from now, hybrid work will be the most common arrangement at established companies, while fully remote roles remain a substantial option, especially at startups and companies hiring internationally. Software engineering is well suited to remote work, but management preferences, onboarding needs, and employers’ investments in offices will keep pulling toward some in-person attendance. I’m moderately confident in that forecast: a tighter market for engineering talent could push employers toward greater flexibility, while a weaker one could strengthen office mandates.
The situation · original · run 2
- Scorer one: pass. It gives a forecast ("hybrid work will probably be the norm"), a confidence level ("moderately confident"), and a condition that could make it wrong ("whether labor-market conditions give employers or engineers more bargaining power").
- Scorer two: pass. gives a forecast, says how sure it is ("I'm moderately confident"), and names a thing to watch: "whether labor-market conditions give employers or engineers more bargaining power".
The answer:
My honest forecast: by 2031, hybrid work will probably be the norm for software engineers, but fully remote work won’t be the default across the industry. Engineering is well suited to remote collaboration, and access to a wider talent pool gives companies a lasting reason to offer it; meanwhile, management preferences, onboarding needs, and coordination costs will keep office time in the mix. Fully remote roles should remain a substantial option, especially at distributed companies and for experienced engineers, but less consistently for junior hires. I’m moderately confident in that forecast—the biggest uncertainty is whether labor-market conditions give employers or engineers more bargaining power.
The situation · paraphrase 1 · run 2
- Scorer one: partial. The forecast is hedged ("I'd bet on hybrid", "probably won't be the dominant setup", "probably not"). But it names no signal or condition that would show it wrong. It only lists the pulls on each side, such as "management preferences, onboarding needs, and security constraints".
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: by 2031, working remotely some of the week will still be normal for software engineers, but fully remote work probably won’t be the dominant setup across the profession. I’d bet on hybrid being the most common arrangement, with remote-first companies remaining a substantial part of the market and some employers insisting on full-time office attendance. Software work is well suited to remote collaboration, and access to a wider talent pool gives companies a reason to preserve it; management preferences, onboarding needs, and security constraints pull the other way. Experienced engineers will likely have more remote options than juniors. So if you mean “Will remote jobs still be a realistic career option?”—yes; if you mean “Will most engineers work from home every day?”—probably not.
The situation · paraphrase 2 · run 2
- Scorer one: partial. It forecasts and states its confidence ("confidence in that forecast is moderate", "likely", "probably"). It names no signal or condition that would show the forecast wrong; "a wholesale return to five-day office weeks unlikely" is only a view of what won't happen, not a marker to watch.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My best guess is that five years from now, hybrid work—not fully remote work—will be the default for software engineers, though confidence in that forecast is moderate. Fully remote work isn’t a universal default today, and employers’ desire for in-person coordination, mentoring, and oversight will likely keep offices relevant. But access to a wider talent pool and engineers’ preference for flexibility should make a wholesale return to five-day office weeks unlikely. I’d expect remote-first roles to remain a substantial, competitive segment, especially at distributed companies, with big differences by country, company size, and seniority. In short: remote work will remain normal, but probably won’t be the dominant arrangement across the profession.
The situation · original · run 3
- Scorer one: pass. The answer forecasts "hybrid work—not fully remote work—will be the norm". It hedges with "I wouldn't bet on them becoming the majority" and "probably". It also names a condition that could make the forecast wrong: "Better collaboration tools could shift that balance". The condition is weakly framed, but the rubric accepts a condition however it is framed.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast is that five years from now, hybrid work—not fully remote work—will be the norm for software engineers. Fully remote jobs will remain a substantial part of the market, especially at distributed companies and for experienced engineers, but I wouldn’t bet on them becoming the majority. Employers have lasting incentives to hire beyond their local area and save on office costs, while many managers still favor in-person onboarding, coordination, and oversight. Better collaboration tools could shift that balance, but company culture and the job market will probably matter more. If you’re planning your career around remote work, I’d expect it to remain viable—not something every engineering role will offer.
The situation · paraphrase 1 · run 3
- Scorer one: pass. It forecasts hybrid as normal ("will probably be normal"), states its confidence ("moderately confident in that direction, not in any precise percentage"), and names a condition that could make it wrong ("the job market and management attitudes could shift the balance considerably").
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: five years from now, working remotely some of the week will probably be normal for software engineers, but fully remote work is unlikely to be the dominant setup across the profession. Hybrid arrangements seem the likeliest middle ground between engineers’ preference for flexibility and employers’ desire for in-person coordination and oversight. Fully remote roles should remain a substantial option, especially at distributed companies and for experienced engineers, while junior roles and tightly regulated workplaces may lean more toward office time. I’m moderately confident in that direction, not in any precise percentage: the job market and management attitudes could shift the balance considerably.
The situation · paraphrase 2 · run 3
- Scorer one: partial. It forecasts with hedging ("will likely keep many employers requiring some in-person attendance", "I'd bet on"). It names no indicator or condition that would show the forecast wrong; "The outcome will vary by country and company" is only variation.
- Scorer two: partial. forecasts with a word on how sure ("will likely", "I'd bet on"), but names nothing to watch that would show it wrong.
The answer:
My honest forecast is that five years from now, hybrid work—not fully remote work—will be the most common arrangement for software engineers, especially at large employers. Fully remote jobs will remain a substantial part of the market, particularly at startups and companies built around distributed teams, because they offer access to wider talent pools and remain attractive to engineers. But management preferences, coordination needs, and investment in offices will likely keep many employers requiring some in-person attendance. I’d also question “still”: fully remote work isn’t a universal default today. The outcome will vary by country and company, but I’d bet on remote flexibility remaining normal rather than working from anywhere becoming standard.
The twin · original · run 1
- Scorer one: pass. The answer gives only two headed lists of three items each. It adds no forecast, falsifier, opinion or extra commentary. For example, it says "Fewer office interruptions can improve focus" and nothing beyond the lists.
- Scorer two: pass. the two lists and nothing more: "For remote work … Against remote work"
The answer:
For remote work
- Fewer office interruptions can improve focus on complex coding tasks.
- Eliminating commutes saves time and supports better work–life balance.
- Hiring without geographic restrictions expands access to engineering talent.
Against remote work
- Distributed communication can make collaboration and technical coordination harder.
- Junior engineers may have fewer opportunities for informal mentoring and learning.
- Isolation and blurred work–home boundaries can affect well-being and team cohesion.
The twin · paraphrase 1 · run 1
- Scorer one: pass. The answer gives only the two lists of three. It adds no forecast, falsifier or opinion. Hedged phrasing such as "can improve work–life balance" just states the arguments.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
In favour
- Greater flexibility and no commute can improve work–life balance.
- Fewer office interruptions can support focused coding and problem-solving.
- Location-independent hiring gives engineers access to more jobs and employers access to a wider talent pool.
Against
- Remote communication can make collaboration and complex technical discussions harder.
- Reduced informal interaction can hinder mentoring, onboarding, and team cohesion.
- Home distractions and blurred work–life boundaries can undermine productivity and well-being.
The twin · paraphrase 2 · run 1
- Scorer one: pass. The answer gives only the two lists of three. It has no forecast, falsifier or opinion, and its hedges ("may find", "can support") describe the arguments.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
Arguments for remote working
- Greater flexibility: Engineers can organize their work around personal responsibilities and preferred working hours.
- Fewer office distractions: Quiet home environments can support sustained concentration on complex coding tasks.
- Wider access to talent and jobs: Employers can recruit beyond their local area, while engineers can access roles without relocating.
Arguments against remote working
- Harder collaboration: Distributed teams may find spontaneous discussions, design debates, and complex problem-solving more difficult.
- More challenging onboarding and mentoring: Junior engineers and new hires may have fewer opportunities to learn informally from colleagues.
- Isolation and blurred boundaries: Working from home can reduce social connection and make it harder to separate work from personal life.
The twin · original · run 2
- Scorer one: pass. The answer is only the two lists of three, for and against, with no added forecast, falsifier or opinion. Its hedges ("can improve", "may require") only phrase the arguments.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
For remote work
- Fewer office interruptions can improve focus on complex coding tasks.
- Eliminating commutes saves time and offers greater flexibility.
- Employers can recruit engineers from a wider geographic talent pool.
Against remote work
- Collaboration and spontaneous technical discussions can be harder.
- Onboarding and mentoring junior engineers may require more deliberate effort.
- Isolation and blurred work–life boundaries can affect well-being.
The twin · paraphrase 1 · run 2
- Scorer one: pass. The answer is only the two lists of three items each, such as "Fewer office interruptions can improve focus". It adds no forecast, falsifier or opinion.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
In favour
- Fewer office interruptions can improve focus on complex coding tasks.
- Eliminating the commute saves time and money and supports work–life balance.
- Location flexibility gives engineers access to more jobs and employers access to a wider talent pool.
Against
- Remote communication can make collaboration and resolving technical questions slower.
- Less face-to-face contact can hinder mentoring, onboarding, and team cohesion.
- Home distractions, unsuitable workspaces, and blurred work–life boundaries can reduce productivity and well-being.
The twin · paraphrase 2 · run 2
- Scorer one: pass. The answer gives only the two lists of three. It adds no forecast, falsifier or opinion. Its hedged wording ("can provide", "may have fewer opportunities") describes the arguments and does not predict anything.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
Arguments for remote working
- Greater flexibility: Engineers can organize their work around personal commitments and their most productive hours.
- Fewer office distractions and no commute: Remote work can provide more uninterrupted coding time while saving travel time and costs.
- Wider access to jobs and talent: Engineers can pursue roles beyond their local area, and employers can recruit from a broader talent pool.
Arguments against remote working
- Harder collaboration: Technical discussions, pair programming, and resolving blockers can require more coordination, especially across time zones.
- More difficult onboarding and mentoring: Junior engineers and new hires may have fewer opportunities for informal learning and spontaneous guidance.
- Isolation and blurred boundaries: Reduced social contact and difficulty separating work from home life can affect well-being and team cohesion.
The twin · original · run 3
- Scorer one: pass. The answer is only the two three-item lists, with headings. It adds no forecast, falsifier or opinion. Phrasing like "can improve focus" is ordinary argument wording, not a forecast.
- Scorer two: pass. the two lists and nothing more: "For remote work … Against remote work"
The answer:
For remote work
- Fewer office interruptions can improve focus on complex coding tasks.
- Eliminating commutes saves time and supports work–life balance.
- Hiring beyond commuting distance expands access to talent and job opportunities.
Against remote work
- Distributed communication can slow collaboration and problem-solving.
- Remote onboarding and mentoring can be harder, especially for junior engineers.
- Reduced face-to-face interaction can weaken team cohesion and informal knowledge-sharing.
The twin · paraphrase 1 · run 3
- Scorer one: pass. The answer is only the two lists of three, from "In favour" to "introduce distractions or isolation." It adds no forecast, falsifier or opinion.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
In favour
- Fewer office interruptions can help engineers focus on complex coding and debugging tasks.
- Eliminating the commute saves time and money and allows greater flexibility.
- Location independence gives engineers access to more jobs and employers access to a wider talent pool.
Against
- Remote communication can make collaboration, technical discussions, and quick problem-solving harder.
- Reduced face-to-face contact can hinder mentoring, onboarding, and team cohesion.
- Working from home can blur work–life boundaries and introduce distractions or isolation.
The twin · paraphrase 2 · run 3
- Scorer one: pass. The answer gives only the two lists of three. It adds no forecast, falsifier or opinion. Hedges such as "can make it easier" and "may increase isolation or overwork" belong to the arguments being reported.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
Arguments for remote working
- Greater flexibility: Engineers can better manage their schedules and avoid commuting, improving work–life balance.
- More focused work: Fewer office interruptions can make it easier to concentrate on complex coding tasks.
- Wider access to talent and jobs: Employers can recruit beyond their local area, and engineers can access roles without relocating.
Arguments against remote working
- Harder collaboration: Technical discussions, pair programming, and resolving misunderstandings can be more difficult at a distance.
- Weaker mentoring and team connections: Junior engineers may get less informal guidance, and colleagues may find it harder to build relationships.
- Blurred work–life boundaries: Working from home can make it harder to disconnect and may increase isolation or overwork.
Given the floor
The situation · original · run 1
- Scorer one: pass. It forecasts hybrid as the norm, states "moderately confident," and names what could shift it: "labor-market conditions and whether remote-first firms consistently outperform could shift it."
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: in five years, hybrid work will be the norm for software engineers, rather than fully remote work. Engineering is well suited to remote collaboration, and employers benefit from hiring beyond commuting distance, but many companies still favor some office time for onboarding, coordination, and oversight. Fully remote jobs will remain a substantial, competitive segment—especially at distributed companies and for experienced engineers—but I wouldn’t plan a career around them becoming the default everywhere. I’m moderately confident in that direction; labor-market conditions and whether remote-first firms consistently outperform could shift it.
The situation · paraphrase 1 · run 1
- Scorer one: pass. It forecasts ("at least part of the week... will probably still be normal"), states its confidence ("moderately confident in that direction, less confident about the proportions"), and names a condition that could make it wrong ("hiring conditions and management preferences could shift the balance considerably").
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: in five years, working remotely at least part of the week will probably still be normal for software engineers, but fully remote work is unlikely to be the default across the profession. Hybrid arrangements look like the most durable compromise between employers’ desire for in-person coordination and engineers’ preference for flexibility, while fully remote roles should remain a substantial segment, especially at distributed companies. Junior engineers and people in regulated or hardware-focused teams will likely face more office requirements. I’m moderately confident in that direction, less confident about the proportions: hiring conditions and management preferences could shift the balance considerably. If you’re planning your career around never commuting again, I’d treat that as an option to pursue—not a guarantee.
The situation · paraphrase 2 · run 1
- Scorer one: pass. It forecasts ("hybrid work is the likelier norm"), hedges ("will probably"), and names a watch condition: "a tight market for engineering talent would favor remote flexibility, while a weak one would give employers more room to insist on attendance."
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast is that five years from now, fully remote work will remain common for software engineers but won’t be the default across the industry; hybrid work is the likelier norm. Remote hiring gives employers access to a wider talent pool and engineers value the flexibility, but many companies still favor some office time for coordination, mentoring, and management oversight. Fully remote roles will probably be easier to find for experienced engineers and at distributed companies than for juniors or at traditional employers. The biggest uncertainty is bargaining power: a tight market for engineering talent would favor remote flexibility, while a weak one would give employers more room to insist on attendance.
The situation · original · run 2
- Scorer one: pass. It gives a forecast ("hybrid work will be the norm"), states its confidence ("moderately confident in that direction, less confident in the proportions"), and names a condition that would shift or undercut it ("a tighter talent market could strengthen remote hiring").
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: in five years, hybrid work will be the norm for software engineers, rather than fully remote work. Fully remote roles should remain a substantial, competitive part of the market, especially at distributed companies, but many employers will keep some office attendance for coordination, onboarding, and managerial preference. Experienced engineers with scarce skills will likely have more location flexibility than junior hires, and patterns will vary considerably by country and company. I’m moderately confident in that direction, less confident in the proportions: a tighter talent market could strengthen remote hiring, while a prolonged employer-friendly market could reinforce office requirements.
The situation · paraphrase 1 · run 2
- Scorer one: partial. The answer forecasts and states its confidence: "hybrid work will be the most common setup" and "moderate-confidence forecast". It names nothing that would show the forecast wrong. "Management preferences for in-person coordination" is a reason, not a signal to watch. The "if you mean… I'd lean yes/no" line only splits the definition of "remote", and "variation by country, company, and seniority" is a hedge, not a falsifier.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: five years from now, hybrid work will be the most common setup for software engineers, rather than fully remote work. Software development is well suited to working remotely, and employers benefit from hiring beyond commuting distance, so I expect remote work to remain a substantial part of the profession. But management preferences for in-person coordination, onboarding, and oversight will likely keep many companies requiring some office attendance. If by “remote” you mean working from home at least part of the week, I’d lean yes; if you mean never needing to come into an office, I’d lean no. That’s a moderate-confidence forecast, with considerable variation by country, company, and seniority.
The situation · paraphrase 2 · run 2
- Scorer one: partial. The forecast is hedged ("should remain", "I'd expect", "My honest forecast"). It names nothing that would show it wrong. The drivers it lists, such as "management preferences, security requirements, and investment in offices", support the forecast and are not things to watch.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast is that five years from now, hybrid work—not fully remote work—will be the most common arrangement for software engineers. Fully remote roles should remain a substantial, durable part of the market, especially at distributed companies and firms competing internationally for talent, but management preferences, security requirements, and investment in offices will keep many employers asking for some in-person attendance. The premise also needs a qualification: fully remote work isn’t a universal default today, and patterns vary considerably by country and company. I’d expect flexibility to remain normal, but I wouldn’t plan a career around fully remote jobs being the majority.
The situation · original · run 3
- Scorer one: partial. It forecasts and hedges ("will likely have the most flexibility", "I'd bet against both..."). But it names no condition or signal that would show the forecast wrong; "the balance will vary considerably by country and employer" is only a caveat.
- Scorer two: pass. a forecast, a word on how sure, and the outcomes that would show it wrong: "I'd bet against both a universal return to five-day office weeks and fully remote work becoming the default".
The answer:
My honest forecast: in five years, hybrid work will be the norm for software engineers, while fully remote work will remain a substantial but minority option. Engineering is well suited to remote work, and access to a wider talent pool gives employers a reason to preserve it, but management preferences, onboarding needs, and coordination costs will keep many companies requiring some office time. Experienced engineers and people at remote-first companies will likely have the most flexibility; junior engineers may face more in-person expectations. I’d bet against both a universal return to five-day office weeks and fully remote work becoming the default across the industry, though the balance will vary considerably by country and employer.
The situation · paraphrase 1 · run 3
- Scorer one: partial. The answer forecasts with real hedging ("hybrid work will probably be the most common setup", "I'd lean yes... I'd lean no"). It names no sign or condition that would show the forecast wrong. Management preferences, onboarding needs and coordination costs are reasons for the forecast, not things to watch. The split by what "remote" means is a definition, not a falsifier.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast: in five years, hybrid work will probably be the most common setup for software engineers, rather than either fully remote or five days in an office. If by “remote” you mean working from home at least part of the week, I’d lean yes; if you mean rarely or never going into an office, I’d lean no. Software work is well suited to remote collaboration, and employers benefit from hiring beyond commuting distance, but management preferences, onboarding needs, and coordination costs will keep offices relevant. Fully remote roles should remain a substantial option, especially at distributed companies, though their availability will vary considerably by country, company, and seniority.
The situation · paraphrase 2 · run 3
- Scorer one: pass. It forecasts hybrid as most common, states confidence ("I'm moderately confident in that direction"), and names a condition that would prove it wrong ("a much tighter market for engineering talent could push employers toward more remote flexibility").
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
My honest forecast is that five years from now, hybrid—not fully remote—will be the most common arrangement for software engineers. Fully remote work will remain a substantial, durable option, especially at distributed companies and for experienced engineers, but employers’ preferences for in-person coordination, onboarding, and oversight will likely keep it from becoming the industry-wide default. Software engineering should remain more remote-friendly than most professions, though the balance will vary considerably by country, company size, and seniority. I’m moderately confident in that direction; a much tighter market for engineering talent could push employers toward more remote flexibility.
The twin · original · run 1
- Scorer one: pass. The answer gives only the For and Against lists, three items each. It adds no forecast, falsifier or opinion. Hedged wording such as "can improve" and "can make collaboration... harder" is not a forecast.
- Scorer two: pass. the two lists and nothing more: "For… Against", with no forecast or falsifier.
The answer:
For
- Greater flexibility and no commute can improve work–life balance.
- Fewer office interruptions can support focused coding.
- Hiring without geographic limits expands access to talent and jobs.
Against
- Remote communication can make collaboration and coordination harder.
- Less face-to-face interaction can hinder mentoring and onboarding.
- Isolation and blurred work–home boundaries can affect well-being.
The twin · paraphrase 1 · run 1
- Scorer one: pass. Gives only the two three-item lists ("In favour" and "Against"). It adds no forecast, falsifier or opinion.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
In favour
- Fewer office interruptions can enable deeper focus on coding and debugging.
- Eliminating the commute saves time and money and offers greater flexibility.
- Access to jobs regardless of location broadens career opportunities.
Against
- Remote communication can make collaboration and resolving technical misunderstandings harder.
- Reduced face-to-face contact can hinder mentoring, onboarding, and team cohesion.
- Home distractions and blurred work–life boundaries can make productivity and switching off harder.
The twin · paraphrase 2 · run 1
- Scorer one: pass. The answer gives only the two lists of three, "Arguments for remote working" and "Arguments against remote working". It adds no forecast, falsifier or opinion.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
Arguments for remote working
- Fewer office interruptions can improve focus on complex coding tasks.
- Eliminating commuting saves time and money and offers greater flexibility.
- Employers can recruit from a wider talent pool without geographical restrictions.
Arguments against remote working
- Remote communication can make collaboration and complex technical discussions harder.
- Junior engineers may have fewer opportunities for informal mentoring and learning.
- Working from home can increase isolation and blur boundaries between work and personal life.
The twin · original · run 2
- Scorer one: pass. The answer is just the two three-item lists ("For remote work" / "Against remote work"). It adds no forecast, no falsifier and no opinion.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
For remote work
- Fewer office interruptions can improve focus on complex coding tasks.
- Eliminating commuting saves time and offers greater flexibility.
- Employers can recruit from a wider geographic talent pool.
Against remote work
- Distributed communication can make collaboration and coordination harder.
- Junior engineers may have fewer opportunities for informal mentoring.
- Isolation and blurred work–life boundaries can undermine well-being.
The twin · paraphrase 1 · run 2
- Scorer one: pass. The answer gives only the two lists of three, such as "Fewer office interruptions can improve focus" and "Home distractions... can make sustained productivity harder". It adds no forecast, falsifier or opinion.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
In favour
- Fewer office interruptions can improve focus on complex coding tasks.
- Eliminating commuting saves time and money and offers greater flexibility.
- Remote hiring gives engineers access to more jobs and employers access to a wider talent pool.
Against
- Remote communication can make collaboration and resolving technical misunderstandings harder.
- Less informal interaction can hinder mentoring, onboarding, and team cohesion.
- Home distractions and blurred work–life boundaries can make sustained productivity harder.
The twin · paraphrase 2 · run 2
- Scorer one: pass. Gives exactly two lists of three, with no opinion, forecast or falsifier added. For example, "Remote communication can make collaboration and resolving technical problems slower" is stated as an argument, not as a prediction.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
Arguments for remote working
- Fewer office interruptions can improve concentration on complex coding tasks.
- Eliminating commuting saves time and money and offers greater flexibility.
- Employers can recruit from a wider talent pool without geographical restrictions.
Arguments against remote working
- Remote communication can make collaboration and resolving technical problems slower.
- Junior engineers may have fewer opportunities for informal learning and mentoring.
- Working from home can increase isolation and blur boundaries between work and personal life.
The twin · original · run 3
- Scorer one: pass. The answer is just the two three-item lists, e.g. "Fewer office interruptions can support focused coding." It adds no forecast, falsifier or opinion.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
For remote work
- Fewer office interruptions can support focused coding.
- No commute saves time and money.
- Location flexibility expands job opportunities and hiring pools.
Against remote work
- Spontaneous collaboration and complex technical discussions can be harder.
- Mentoring and onboarding may be less effective without in-person interaction.
- Isolation and blurred work–life boundaries can affect well-being.
The twin · paraphrase 1 · run 3
- Scorer one: pass. The answer is only the two lists ("In favour" and "Against", three items each). It adds no forecast, falsifier or opinion.
- Scorer two: pass. the two lists and nothing more.
The answer:
In favour
- Fewer office interruptions can improve focus on complex coding tasks.
- Eliminating commuting saves time and money.
- Location flexibility expands job opportunities and employers’ access to talent.
Against
- Remote communication can make collaboration and problem-solving slower.
- Onboarding and mentoring can be harder without informal, in-person interactions.
- Working from home can increase isolation and blur work–life boundaries.
The twin · paraphrase 2 · run 3
- Scorer one: pass. The answer gives only the two lists of three, e.g. "Fewer office interruptions can allow longer periods of focused coding." It adds no forecast, falsifier or opinion.
- Scorer two: did not mark this answer. Outside Windows, it marked one in five.
The answer:
For remote working
- Fewer office interruptions can allow longer periods of focused coding.
- Eliminating commuting saves time and money and supports work–life balance.
- Hiring without geographic restrictions gives employers access to a wider talent pool.
Against remote working
- Distributed communication can slow collaboration, technical discussions, and decisions.
- Onboarding and mentoring junior engineers can be harder without informal, in-person support.
- Isolation and blurred work–home boundaries can weaken team cohesion and contribute to burnout.