Pages

Sunday, 10 July 2022

The latest on SIMS Next Gen

Disclaimer: I have past and present commercial relationships with many MIS vendors, including an ongoing involvement with Compass, an Australia-based MIS that is launching in the UK. I'm also a co-founder of two assessment startups - Smartgrade and Carousel - that exist in markets adjacent to the MIS. Nonetheless I aim to write this blog impartially, from the perspective of a neutral observer. This matters to me - it's basically the blog I wish had existed back when I was a MAT senior leader trying to get a handle on MIS and edtech. I also now provide MIS market datasets and reports as a service and offer free, informal consultations on MIS procurement to schools and MATs. If you would like to discuss any of this, contact me on Twitter or LinkedIn.

I'll soon be getting hold of the May MIS census figures from English state schools, and it's a big release for SIMS-watchers. Why? Well, in November last year the company announced that schools would be required to move from their previous annual contracts to mandatory 3 year contracts, and, let's just say the news wasn't universally well-received by their customersSIMS contracts run from 1st April to 31st March, so the immediate effect of this change was that schools had to decide whether to stay and accept the longer contract, or go elsewhere fast. (A couple of months later SIMS did offer a six months break clause after what Schools Week describes as a "backlash" from schools, but still, you'd assume that if there will be an increase in switching, we'll see evidence of that in the May data.)

So to help make sense of the imminent data release, I thought I'd investigate how SIMS are presenting their offer almost a year after the acquisition by ParentPay. But before we check out the latest announcements, here's some context. In September 2021 Mark Brant (Group CEO of ParentPay) set out his highlights from the first 5 weeks of owning SIMS. This included announcing that they were "massively out-investing all our MIS competitors" and that they would "spend more than £40 million to modernise the product portfolio and radically improve the quality and breadth of the services ESS delivers". He also talked about a culture of "less bureaucracy and fast decision making".

Then In October 2021, Brant announced Next Gen SIMS, offering "Cloud-based, continuous improvement from Spring 2022". This was newsworthy for a couple of reasons: 

    • It sounded like a tacit admission that SIMS Primary, their pre-existing cloud initiative unveiled in January 2018, was being shelved.
    • But it also sounded like there was a Big New Plan - "Next Gen will be deployed as pure cloud-based applications and will sit alongside existing SIMS features", says Brant. This appeared to mean that existing SIMS would be available in its current form via a browser, alongside new native-cloud modules. In an approach described as "Evolution, not revolution", the implication was that the user would get all of SIMS in a browser, with the old bits being replaced one by one with new cloud SIMS. The article implied a quick rollout - Brand says "Best of all, these improvements will begin to be delivered for all our SIMS schools at no additional cost, starting in Q1 2022."

So where are SIMS now? Well, this recent sponsored post in Schools Week provides something of a progress report. First, it reiterates the £40m development pledge, and says of Next Gen that the "first slice of technology is Take Register for primary school teachers", which has been piloted in "dozens of schools". Here's the part about new functionality in full:  

Cover teachers can now take registers when the regular teacher is absent; users can view notes against attendance marks; and we’re working to ensure users can add and edit new notes, too. Our development teams are also making progress in adapting Take Register to make it suitable for secondary schools. You can find out more about Take Register by clicking here. 

  

I’m also very pleased to report that another slice of SIMS Next Gen has recently gone into pilot mode. Teachers need quick and easy access to the contact details for parents and/or guardians of their learners. We’ve been developing our Learner Contacts functionality to do exactly that. Look out for an update on where we are with this in our next piece!


I also found this April 2022 article from the SIMS blog useful to understand how the company is coping with the tricky technical challenge of running Next Gen and SIMS 7 side by side. It says:


        It takes just five minutes for Take Register’s data to be synchronised back into SIMS.


Or, to put it another way: Take Register doesn't update the SIMS database in real time; there's seemingly a process it goes through before committing any changes.


Then the latest article on the SIMS website includes further details on planned developments:


Our next slice, which is currently in pilot, is Pupil Contacts functionality. The ability to use Pupil Contacts on a mobile device has proved popular, due to its accessibility for activities that happen outside the school building.   


The team is now focused on moulding enhancements around the insight and feedback that they’ve received from the pilot. In fact, changes have already been made – such as improved search functionality to support more flexible inputs, or ‘fuzzy’ search and design improvements to make it easier to move around the various features. There’s more to do to, such as optimising Pupil Contacts for tablet screens, before we roll out the slice to all Primary Schools. 


And we’re delighted to announce plans to take our latest slice, our MAT reporting tool, into pilot later this year. This is powerful technology, which harnesses AI and Machine Learning, to identify areas of concern surrounding attendance.


My interpretation of all this is:

  1. The pace of SIMS Next Gen is ramping up - we're getting more and more information shared with us, and there are now several areas either in development or being piloted.
  2. That said, the only thing that will be live at any scale for the new academic year is "Take Register". And even then, that's currently in pilot for primaries only, though a wider rollout is planned for the summer. 
  3. SIMS aren't rushing to release Next Gen screenshots (I can't find any on the blog or elsewhere).
  4. Users can't yet add and edit new notes via Take Register (which may be linked to the technical complexities of running a local database and a cloud module side by side?). 
  5. The rollout of Next Gen will be a long-term, multi-year thing. After all, SIMS has *lots* of modules, and plenty of them (like behaviour and attendance, say) are not mentioned yet.
  6. Improving the experience on phones and tablets is a priority - though the expectation is seemingly for such access to be via a browser with responsive design rather than through native apps; otherwise it wouldn't make sense to say "optimising Pupil Contacts for tablet screens". I'm not clear what that means for the future of the SIMS Teacher App.
  7. MAT Analytics is a new focus area, presumably to improve MAT retention, which has been a particularly challenging area for SIMS in recent years. That's very much my thing, so I'll be watching for further announcements in this area with interest. In particular I'll be looking for specifics on how they plan to bring in AI and ML to attendance analytics. Or to put it another way, what will AI do that a rules-driven report ("show me pupils who have <95% attendance") couldn't? As I've blogged about before, AI is only the answer in edtech if you have a clear understanding of the question you want it to answer, and why traditional approaches aren't up to the job. Don't get me wrong, SIMS could have great answers to these questions! I just don't know what they are yet, so I'll be excited to find out more...
Will this be enough to stop schools and MATs from switching away from SIMS? Well, I prefer data to speculation, so hang tight for my imminent blog about the May 2022 census data to find out!

Monday, 14 March 2022

I'm boycotting BETT, and I suggest you should too

DISCLAIMER: This blog is written in a very personal capacity. I work as an advisor to a range of companies in the education sector, and this blog is in no way intended to reflect their views. I'm not trying to speak for anyone other than me; I simply encourage anyone taking the time to read this to reflect for yourself on where you stand, and act accordingly.

[UPDATE: Quite a lot happened after I wrote this bog. Here's my Twitter thread following Hyve's announcement later that week. And here's the Hyve announcement about the disposal of the Russian business for "a maximum cash consideration of £72 million". I'm not planning to comment further]

If you're in Moscow between April 12th and April 15th you can attend Securika, which the organisers describe as "the must-attend security industry business event" (according to Google Translate). You'll have the chance to check out suppliers of surveillance systems, perimeter fencing and armored complexes. Obviously if you're a journalist you'll need accreditation (this is Russia, now) And don't miss the opportunities for CPD - you can attend sessions on the use of Unmanned Aerial Vehicles in security and the application of AI in video surveillance.

But of course you're not going to Securika. Russia is at war with Ukraine for goodness sake. And anyway, if you read my blogs you probably work in education - why would you want to support the security industry (or any aspect of Russia's heavily sanctioned economy, for that matter) in a a country that is waging a war of conquest and arresting people for holding up blank signs?

Well, the problem is, Securika is staged by Hyve Group, the LSE-listed events business who also operate BETT. And Securika is not their only Russian event; Reuters reports that 27% of their revenue comes from Russia through events in electronics, laboratory equipment, mining and the like. So if you're off to Bett later this month, you're supporting the company behind Securika, whether you like it or not. 

Sure, you might say, but the world is complex and the Russia-Ukraine war is a very recent phenomenon - isn't it harsh to blame Hyve by association? Let's at least hear what they have to say about the situation before we throw them under the bus.

Well, here's an excerpt from their only public proclamation on the "Russia/Ukraine conflict" to date:

Hyve continues to closely monitor the situation in Russia and Ukraine. At present colleagues in both countries are safe and the Group remains in daily dialogue with its teams to provide support.
The Group has taken the decision to postpone events in Ukraine, which represent less than 3% of the Group's revenue, until further notice. At present the Group has seen no impact on its events schedule in Russia, but anticipates disruption to Western participation as a result of the ongoing conflict. The Group is currently assessing the potential impact of the latest sanctions by the EU, the UK and the USA. Revenues from the Group's Russian events are contracted in roubles and other currencies, while the costs of organising the events are incurred primarily in roubles, limiting the Group's exposure to the impact of rouble devaluation on profitability. 
[...] 
A further update will be provided in due course as appropriate.    

So no condemnation (it's the "Russia/Ukraine conflict", dontcha know - you wouldn't want to be seen to be taking sides); no acknowledgment of any humanitarian impact other than the safety of their staff; just reassurances about the way the group is able to limit the financial impact of "disruption to Western participation". 

"Why are you telling me all this?", you might ask. You don't endorse Hyve's Russian operations - you just want to meet up with colleagues and customers in the education technology space and stay out of anything political.

And while I have sympathy with that view, I don't think it meets the moment. Companies in all industries are pulling out of Russia because, as Anna MacDonald from Amati Global Investors says in the linked BBC article, "it was just utterly inappropriate to continue to [generate profits from Russia]". And it's not like these events snuck up on Hyve - Russia annexed Crimea in 2014 and things have festered or escalated ever since. 

So here's my bottom line: if Hyve want the sector to continue to support BETT, I think we should ask that they should announce the cancellation of all Russian events. If they don't do that, we should not go.

That's a tough thing to ask of them and I appreciate it's easy for me to say and much harder for them to do. Employees' jobs (and maybe also safety) would be at risk, I assume local authorities would be angry; money will be lost. And the world is complex: I would understand a Hyve employee or shareholder lamenting the hypocrisy of amateur do-gooders like me who criticise them while buy goods and services from other repressive regimes, wittingly or unwittingly. This isn't thrown in as polite window dressing - I absolutely don't think I (or any of us) have unimpeachable moral credentials, and I will approach any further public statement from Hyve with an open mind. My hope is that they do pull out of Russia, and I would give them huge respect and credit if they do so. 

It's also a tough thing to ask of you. Maybe you feel it's not your call to make; perhaps you don't want to get in trouble with your employer; or it could be that you feel you can't afford to lose money and custom by pulling out. These are all big decisions, and I'm not going to judge anyone for the way they make that decision. Honestly, I feel uncomfortable writing such a confrontational blog, and if I knew people at Hyve I'd probably prefer to petition them behind the scenes, at least at first.

But of course I have written this blog, and I've done so because I can think of no other event in my adult lifetime where the moral imperative to take a side is so clear cut. Global affairs are often complex. Civil wars can seem impenetrable from the outside. Some conflicts have been raging from before we were born. But never have I lived through a totalitarian country trying to extinguish its neighbour's desire to choose a democratic future for itself. It has echoes of the past and lessons for the future that require us to take a stand. If I were old enough, I want to believe I would not have done business with companies that operated in apartheid South Africa. Putin's Russia has earned for itself a place in the world no less deserving of pariah status.

It's time for Hyve to get out of Russia, and if they don't, I would encourage you to join me in boycotting BETT.

Saturday, 1 January 2022

MIS MARKET MOVES WINTER 2021: SIMS is in trouble; Arbor is the biggest beneficiary

Disclaimer: I have past and present commercial relationships with many MIS vendors, including an ongoing involvement with Compass, an Australia-based MIS that is launching in the UK. I'm also a co-founder of two assessment startups - Smartgrade and Carousel - that exist in markets adjacent to the MIS. Nonetheless I aim to write this blog impartially, from the perspective of a neutral observer. This matters to me - it's basically the blog I wish had existed back when I was a MAT senior leader trying to get a handle on MIS and edtech. I also now provide MIS market datasets and reports as a service and offer free, informal consultations on MIS procurement to schools and MATs. If you would like to discuss any of this, contact me on Twitter or LinkedIn.   

SIMS is in trouble. 

Following a year in which they were acquired by Montagu and then merged with ParentPay, the kindest thing you can say about SIMS's strategy is that it is, umm, defensive. Here are their two most high profile moves in recent months:

  1. They've had to change their cloud strategy yet again. SIMS first piloted a cloud version of SIMS in 2014 in Northern Ireland. It didn't go well and the project was pulled. They then relaunched their second attempt at a cloud product ("SIMS Primary") in 2017. So how's that going? Well, the most recent announcement from SIMS launched something called Next Gen SIMS and it seems to be... not SIMS Primary? According to the release "the components of Next Gen will be deployed as pure cloud-based applications and will sit alongside existing SIMS features, giving users the opportunity to move across at their own pace." I take that to mean that they're releasing planning to release new cloud SIMS modules one by one, and as an alternate way to access and use your existing SIMS database, with a long-term gradual move of the whole product to the cloud. But I may be wrong? Maybe it's a sort-of cloud emulation of existing SIMS that can be iterated into a cloud product? Either way, I also assume that SIMS Primary is no more since it isn't mentioned at all in the announcement.
  2. They're forcing customers onto three year contracts at short notice. To say it's been controversial is an understatement: it's gone down so poorly that 400 of their customers have signed up to collective action to resist the changes!
So how have SIMS ended up year after what has presumably been a busy year of strategising? Well, as it happens, I have a chart for that:

What this shows you is that the percentage of the previous year's English state school customers leaving SIMS (i.e. their "churn") has increased from 0.7% in 2014 to 5.9% in 2021 (941 schools in total). The churn rate accelerated significantly over the past year. My basic rule for the MIS market is that churn of above 5% is a big warning flag. Schools don't move MIS without a good reason to do so - there's quite a lot of change management involved, so the perceived hassle has to be triggered by some kind of justification. 

There's not much reassurance for SIMS in the phase breakdown either:

The secondary number will be particularly concerning for SIMS. Primary churn has been above 3% for four years now, so SIMS will have become somewhat resigned to leaking schools at this phase, but the migration away from the secondary product is a newer phenomenon. And that's just the historical data - if you're sitting in SIMS HQ, and you extrapolate a trend line for the next 2-3 years from that data, well, I guess that's what leads you to lock up your customers by any means possible while you still have them!

So how does this compare to their rivals? Well, if we overlay the churn rates of the main market players you see that Bromcom, Arbor and ScholarPack all now churn well under 2%.

It's not good news for all of SIMS's challengers, mind: Pupil Asset (now rebranded as Juniper Horizons) will be disappointed to have lost 6.9% of their customers, having got churn down to just 1.3% the previous year, and RM would have preferred to break what is now a six year streak of 3%+ churn.

So how does that impact the bigger picture of the English state school market? As usual, here are some pretty interactive Tableau charts; below them is my analysis of the main trends.


  1. Arbor won the year. Arbor's market share by # schools grew by 2.8% (from 4.8% to 7.6%). That's by some distance the biggest one-year rise for any company in the twelve years I've been gathering data. And there's more: while they've been the biggest winner on that metric for a few years now, what's new is that they grew by 2.7% measured by number of pupils (from 4.0% to 6.7%). This reflects their relatively recent competitiveness at secondary: in 2021 they won 75 secondaries compared to 66 for Bromcom. In 2020 it was 58-52 in favour of Bromcom and in 2019 it was 57-14 to Bromcom. Arbor also won this year's most hotly contested procurement, when AET chose them to provide a MIS to their 57 schools. (Bromcom are contesting this, having also raised a similar legal challenge after losing United Learning's tender to Arbor last year. This column isn't the right place to debate the legal merits of either action, but I will say that I worry for Bromcom that any upside gained by legal means will be more than offset by the negative publicity that comes from taking high profile MATs to court. Large MATs are influential; MATs  don't like being sued; and MAT leaders talk to each other...).
  2. Bromcom remains Arbor's main rival. All that said, Bromcom had a good year too, posting their biggest annual rise to date. They now have 4.0% of the market by number of schools (2020: 2.9%) and 5.8% of the market by number of pupils (2020: 4.4%). That makes them the clear number two challenger after Arbor right now. They'll also have been pleased to have won the recent Hackney LA procurement for a MIS and finance system in November 2021. Hackney have been SIMS users, so the decision to move wholesale to another vendor (rather than opt for a framework or just leave it up to schools) is a big deal, and it will be fascinating to track whether other LAs go down this route. The Hackney schools haven't started switching yet, so Bromcom's numbers should see a commensurate boost over the coming year or so as the migrations happen.
  3. ScholarPack is still growing. These days The Key own two MIS: Arbor and ScholarPack. It's therefore legitimate to wonder if they plan to keep both MIS live in perpetuity, or whether they'll start prioritising the Arbor platform, which is all-phase whereas ScholarPack is primary-only. Well, there's no evidence of any change of that nature happening yet. Only 5 schools left ScholarPack to join Arbor over the period, and 191 schools joined ScholarPack, which is the biggest gain since 2018, indicating a continued (and successful) sales effort.
  4. Nobody else is making much of a dent yet. Juniper Horizons (the MIS formerly known as Pupil Asset) gained 46 schools, which initially looks like a good effort and matches their number of wins in 2019 after adding just 9 in 2020. However, they also lost 31 schools, mostly to Arbor, so the net gain ends up being a more modest 15 schools. iSAMS (now marketed by new owners IRIS as Ed:Gen) achieved just 3 new wins alongside 1 loss, leading to a net gain of 2 schools. Faronics' attempt to enter the market seems to be over - they've been stuck at 1 school for 4 years, so I've now lumped them in with the "others" as there doesn't seem much point tracking them in their own right. Now the challenger picture could change in 2022 - I've no doubt that Juniper and IRIS continue to invest heavily in the market, and if you read my disclaimer at the top of the article you'll have noticed that I'm helping Compass, an Australian MIS, to enter the market. So if you're a MIS commissioner, the good news is that you have several promising cloud options to consider alongside the established challengers. This is a competitive sector!
  5. Advanced faces an uncertain future. Advanced's market share is down to 1.2% (from 6.3% a decade ago). Of their 275 remaining schools we know that 57 from AET are already on their way to Arbor, so without a rush of new sales they'll be below 1% pretty soon. And it's hard to believe that many new sales are coming their way in light of the fact that just two new schools joined them over the past year. I'm not sure how you turn that around.
  6. SIMS' market share from schools in large MATs has halved since 2014. In 2014 SIMS had 80% of the schools that are now part of the country's largest (30+ school) MATs. That share is now down to 39%. Large MATs only represent around 5% of the country's schools, but they're influential, as smaller MATs look to them for guidance on how to navigate the market. It's worth noting that Bromcom are the biggest challenger by some distance in this sector, with Ark, Harris, Hamwic, Oasis, David Ross and Leigh Academies Trust all choosing them. That said, AET's move to Arbor isn't yet reflected in the data, so that'll boost Arbor somewhat once those schools do move over.
  7. LAs are becoming mixed economies. My charts above include analysis of the market share in the largest LAs for the first time. I don't see a tonne of difference in the behaviour of larger LAs vs smaller LAs, but I find it's actually more helpful to look up close at a sample of LAs than try and look at their numbers in aggregate, so that's why I've included this analysis. And what you see when you look up close is that SIMS had an 90%+ market share in 14 of those 21 largest LAs in 2014, whereas in 2021 that's true of just 2 of them. I think this is significant - one thing that's propped up SIMS's market share is schools not really understanding that they have a choice. If your LA has a MIS support team and they only work with SIMS, you may be disinclined to look elsewhere, but if the school down the road is using something else, you'll be more open to contemplating alternatives. I also see evidence in the market of MIS support teams changing their business models to support multiple MIS, which reduces the barriers to switching: if you can keep your friendly support team while changing MIS, migration might seem less of a big deal. 
So what will 2022 hold? Well, the big question in the short term will be how many SIMS schools decline the now-mandatory 3-year contract and move elsewhere by March 31st. We'll know that when the May census data is published around July 2022, so keep your eyes peeled for my summer blog on the subject! That said, personally I think that the autumn 2022 data will be even more intriguing (i.e. a year on from this blog), as it will give us a true sense of whether challengers find ways to win SIMS school in spite of the three year lock-up. It'll also be clearer whether other challengers are starting to match Arbor and Bromcom when it comes to competing for schools.

Wednesday, 29 September 2021

A treasure trove of insight on the English school assessment sector


If you’ve read any of my blogs before you’ll know I’m a data geek. However, the first blog I wrote (in 2014) contained no data whatsoever. Rather, it was mostly a grumble about the lack of good quality data in education. 

Then I managed to get hold of data on the school Management Information System market, so I started focusing on that in my blogs. This made some MIS-market watchers happy, but friends in other sectors would contact me and say things like “hey, we don’t care about MIS as much as you, so can you do the same thing for our sector?” And sadly, the answer was invariably “no”, because I just didn’t have the data to do justice to the question.


Until now, that is.


Because, for those of you who track English school assessment, the very good news is that I’ve found my dream data partners in the guise of the good people at Education Intelligence (the team behind Teacher Tapp). I don’t think this is as widely known as it should be, but they have this super-cool thing called the Education Intelligence Tracker, which keeps tabs on what school staff think about education suppliers. They track *literally* hundreds of companies by asking the following questions to several thousand teachers at a time:


  1. Have you heard of the following company?

  2. Do you currently use or have you used the following company in the past 6 months?

  3. Would you recommend the following company to a colleage?


And so, joy of joys, my consultancy (Edtech Experts) and Education Intelligence have worked together over the past few months to publish a data-rich insights package focusing on the English school assessment sector. Here’s what we’re offering:


  1. A dataset of the 57 companies covered by Teacher Tapp with a significant assessment component to their offer. Yes, you read that right, 57 companies! The neatly structured dataset includes answers to the questions above at overall level, and also broken down by lots of sub-categories (e.g. primary vs secondary, teacher vs middle leader / senior leader etc). This is the first time that Teacher Tapp have ever made this much of their data available in one purchase, and as a consequence the bundle is brilliant value for money.

  2. A report written by Edtech Experts both analysing Teacher Tapp’s data and also incorporating qualitative insights from interviews with a wide range of sector experts. So as well as the data analysis you get sections on how the assessment market is segmented, the big trends in English school assessment, how schools procure, a market sizing exercise, and even a “deals summary’ covering signification investment and acquisition activity at the focus companies over the past 3 years. 


The package will therefore help you to understand:


  • How the English school assessment sector is structured and segmented 

  • Which are the growth areas 

  • Which assessment products are popular (and which ones are not)

  • Strategies investors are using to expand in the assessment space

  • How schools procure assessment products


If that’s all still a bit abstract, here are a few nuggets that made me raise my eyebrows as we put the report together, and which you’ll be able to explore in much more detail by purchasing the package:


  • The combined market share of Microsoft Teams and Google Classroom in English schools is now over 100%! That means most schools are seemingly using one of the two, and some are using (or experimenting with) both.

  • Single subject and quizzing products are very popular with teachers; assessment management platforms (including MIS) are not.

  • Standardised assessment is big business.


Special thanks go to Ed Tranham of The Assignment Report, who was hugely helpful in pulling together the deals summary - if you don’t have a subscription, I thoroughly recommend them as a source of news on the business of education.


So, if you’d like to know more about our insights package on the English school assessment sector, or get an idea of pricing, drop me an email at josh@edtechexperts.co.uk, or DM me on LinkedIn or Twitter.

Saturday, 24 July 2021

MIS MARKET UPDATE (Summer 2021): SIMS dip below 70% market share

Disclaimer: I have past and present commercial relationships with many MIS vendors, including an ongoing involvement with Compass, an Australia-based MIS that is launching in the UK  Nonetheless I aim to write this blog impartially, from the perspective of a neutral observer. This matters to me - it's basically the blog I wish had existed back when I was a MAT MIS commissioner trying to get a handle on all things relating to MIS and edtech. I also now provide MIS market datasets and reports as a service and offer free, informal consultations on MIS procurement to schools and MATs.  If you would like to discuss any of this, contact me on Twitter or LinkedIn.   

No time for small talk this term - I'm going to get straight to the point. I've just got hold of the latest termly data on the School Management Information Systems (MIS) used by state schools in England. Here are the headlines:

  1. SIMS dipped below 70% market share when measured by number of schools. I now have eleven years of MIS market data. SIMS' market share peaked in 2012 at 84%. This summer they dropped below 70% (69.6% to be exact). It's higher when measured by pupil numbers (74.6%), but still, the direction continues to be downwards however you cut it.
  2. 528 schools switched over the past term. That's high by historical standards. We don't have exact data for 2020, because there was no summer census (damn you, COVID, for messing up my beautiful term-by-term dataset), but my educated extrapolation is that the figure for the equivalent period last year was 480-490, and in 2019 the summer term number was 430. That follows a strong number the previous term, which leads me to estimate that there will be c. 1,000-1,050 switchers in the full year to autumn 2021 when we get next term's numbers. That would be a historic high since (my) records began in 2010.
  3. Wins are still dominated by Arbor, Bromcom and ScholarPack. This isn't news, but there are some interesting subplots to the story. On which note...
  4. Arbor and Bromcom are neck and neck with secondary wins. Bromcom remains the dominant challenger with secondaries - they have 299 schools compared to 135 for Arbor. However, Arbor now match them when it comes to new wins. In 2019, Bromcom won four new schools for every school joining Arbor. But over the past term, 29 secondaries joined Arbor, compared to 22 joining Bromcom. Why the change? Well, United Learning had a lot to do with it, accounting for 17 of Arbor's wins. But still, something seems to have changed: over the past four terms, the two have been more or less equally successful with secondaries (Bromcom has 87 wins to Arbor's 84). 
  5. MAT schools are still more likely to switch, but LA schools are catching up. Around 45% of English state schools are academies, but academies (most of which are now in MATs) represent 62% of the switchers. That said, LA schools are increasingly getting in on the switching act: in Q1 of 2018 they represented just 14% of switchers, whereas last term 38% of switchers were LA schools.
  6. Pupil Asset (now sold as Juniper Horizons) won more schools than SIMS over the past term. It's been a quiet few years for Pupil Asset, so the Juniper team will be heartened to see 25 schools come their way over the past term. That's not at the level of the "big three" challengers, but it was more than SIMS managed to win over the same period (they had 18 wins). Aside from bragging rights for the non-trivial number of ex-SIMS employees now at Juniper, this also points to how  SIMS hasn't (yet) found a way of winning schools away from the challengers. Having said that, new owners Montagu have only just had their merger with ParentPay confirmed, and so it feels too early to judge the impact of the new owner's strategy on the long-term prospects of the business.
As always, here are some pretty charts which you can use to explore for yourself:

Saturday, 19 June 2021

MIS MARKET UPDATE (JAN 2021 DATA): Churn, Baby Churn.

Disclaimer: I have past and present commercial relationships with many MIS vendors, including an ongoing involvement with Compass, an Australia-based MIS that is launching in the UK  Nonetheless I aim to write this blog impartially, from the perspective of a neutral observer. This matters to me - it's basically the blog I wish had existed back when I was a MAT MIS commissioner trying to get a handle on all things relating to MIS and edtech. I also now provide MIS market datasets and reports as a service and offer free, informal consultations on MIS procurement to schools and MATs.  If you would like to discuss any of this, contact me on Twitter or LinkedIn.   

I feel sorry for local news organisations. I grew up in the south west of England, and occasionally stuff happened, but more often that not the local news sounded like: 

Something something council business, bla bla squirrels are hurting trees, yadder yadder oh look a royal came to the County Fair... 

You get the idea.

Nonetheless, those dutiful regional news teams still had to put out their obligatory half hour of programming, or an unfoldable broadsheet newspaper, or whatever. They had to pretend that everything that they reported on was a big deal. The temptation to arrive on camera and just fess up to the absolute chasmic absence of news must have been overwhelming. "It's 9pm, thanks for joining us, but honestly you really shouldn't have bothered. Make your dinner and come back when Tomorrow's World will be reporting on a curious new invention called the internet." That's the kind of content I'd have respected. 

I felt a bit like that when I was preparing this blogpost. Don't get me wrong, there's some good stuff below (e.g. more schools are switching!), but at the same time, if you caught my December 2020 update on the MIS market, you're unlikely to be blown away by the newsiness of it all. Still, you're probably committed to at least a quick skim at this point, so let's get into it.

I recently received school MIS market data from January 2021. I've been requesting the termly files for a couple of years now, so I was able to combine it with data stretching back to October 2018 to analyse termly trends. What follows are my five key takeaways, accompanied by some charts, where I think they'll help to emphasise a point.

So, here we go.

1. SIMS churn is at an all time high; challenger churn is at all all-time low

The most important number for all MIS market participants is churn: that is, losses over the past twelve months divided by the number of schools twelve months ago. For established players, you want this to stay low to protect your position. For challengers, you want it to be high.

I've blogged before in my annual blogs about how SIMS churn has grown steadily since 2014 when it was under 1%. The term-by-term data shows this trend continuing. The following chart shows annualised churn using a rolling average of the three previous data periods for the five leading MIS. What you see is:

  • Overall churn has been hovering around 4% for a couple of years, and is showing signs of ticking upwards. 
  • SIMS churn hit 4.5% in Jan 21, the highest rate over the period (and the highest since at least 2010, when my main annual dataset begins).
  • There are two clear groups when it comes to churn: the two largest MIS (SIMS and RM), who both churn around 4-5% with churn ticking slowly upward; and the three main challengers (Arbor, Bromcom and ScholarPack), who have been churning at 0-2.5%, with churn ticking notably downwards, particularly in the most recent data set.
That last point is particularly key for those trying to understand where the market is heading. In summary, it's good for challengers! They're keeping their schools while seeing an ever-expanding pool of switchers to fight for. In an ideal world, the challengers would of course love overall churn (which for a while will still mostly mean SIMS churn) to tick up closer to, say 10%. But in the meantime, they can probably live with 4-5% of schools being up for grabs every year, particularly if their own customers staying loyal.



Another way of seeing how churn is changing is to look at the last three years of Oct-Jan switching data only, and compare like-for-like volumes. What you see is that wins are at a three-year high over that period (196 in 2021 vs 191 in 2019 and 145 in 2020). So, while there's no dramatic change, the signs do point to continued growth in switching.



2. The Key and Bromcom continue to be the destinations of choice for switchers.
Arbor, Bromcom and ScholarPack continue to be the big 3 MIS in terms of winning over switchers, so there's nothing new there. However, what is new is that Oct 20-Dec 21 was the first period I've ever seen where SIMS was only the fifth best MIS for new wins (Pupil Asset managed to win 5% of schools, compared to 4% for SIMS). Now this could be a blip - SIMS were acquired by Montagu during the period in question - and that kind of transaction is bound to lead to some short-term disruption. Nonetheless, the new management team at SIMS will no doubt be doing all they can to reverse this trend in future periods. Conversely, the Pupil Asset team (who have recently rebranded to Juniper Horizons) will be cheered to see those signs of growth after a comparatively quiet previous year or two.

Another thing to note is that, as with overall market numbers, it makes a difference whether you're looking at schools won, or the number of pupils in schools won. Bromcom won 16% of schools in the period (3rd place for wins), but 25% when measured by pupils (2nd place for wins).



3. Secondaries have (at least) two non-SIMS cloud options.
For at least a year now, Arbor and Bromcom have together accounted for c. 75%+ of secondary switchers, with a fairly even split between the two.  That's a significant change from 2019, when SIMS were stronger and Arbor had less success with secondaries. 

That's surely good news for schools, who will be increasingly aware that they have (at least) two cloud options. 



4. That said, there are plenty of other people trying to shake up the market 
Of course, that doesn't mean things won't *ever* change. The last year has seen huge upheaval in the market: as well as The Key buying Arbor, IRIS bought iSAMS and Juniper bought Pupil Asset. Faronics have been looking to grow a market presence for a few years now, and Go4Schools also have an embryonic MIS. Keep an eye on ET-AIMS, which has recently entered the market too. And of course, as I mentioned in my disclaimer, I'm also now helping Compass (an Australia-based global MIS vendor) to launch in the UK. That's a lot of additional energy being expended on trying to shake up the market...

5. You now have a choice for your MIS market analysis! 
I sometimes mention how I was inspired (and helped greatly) to get started with MIS market by Graham Reed, who was the first to produce publicly available MIS market stats, and still cranks out interesting MIS analytics in Power BI. Well, now The Key have gotten in on the act, with their very own Tableau-powered MIS market analysis

What I'm saying is: we're basically now our own sector. Perhaps someone will start a blog to analyse our market share of MIS market page views? And it can surely only be a matter of time before we get our own BETT award category?

Anyway, given this new competitive landscape, I feel the need to provide at least a couple of interactive charts as a thank you for making it all the way to the end. So to close out the blog, here is the full term-by-term picture from Oct 2018 to Jan 2021 (both by school and pupil numbers):


Saturday, 20 February 2021

In edtech, AI is only the answer if you know the question

There's much talk these days about how Artificial Intelligence (AI) and Machine Learning (ML) can transform education. Century Tech have just announced Century APIs, which moves them from being a learning platform to being also a form of middleware, providing partners with access to their AI technology as a service. Sparx have been busy building a personalised learning experience for schools (though they prefer to describe their approach as "Intelligence Augmentation" rather than full AI). And Quizlet (an edtech "unicorn") have a service called Quizlet Learn, which uses ML to provide an adaptive learning experience. 

Now, I'm not an expert in the area, so this blog isn't going to be a rigorous analysis of what AI/ML is, or who's doing it best. But I am an edtech entrepreneur, and I hear lots of other edtech entrepreneurs considering whether to use AI/ML, so the purpose of this blog is to propose a way of answering that question.

Or, to put it another way, I'm asking: "what problems should AI be trying to address?". I've seen too many business plans which can be summarised as: "we're a bit like other things, but with AI, so better"; and that might be true... but why? 

Let's examine the question by using the following wildly simplistic anatomisation of the learning process:

  1. Content (knowledge, facts, ideas, skills etc) is created in the form of lesson plans, videos, worksheets, quizzes and such.
  2. That content is shared somehow with a student.
  3. The student attempts to absorb the content using the materials provided.
  4. A teacher (or software) marks the student's work.
  5. (Sometimes) the student revises or revisits that content.
  6. (Sometimes) there is a final test to assess whether the content was correctly learned.

So, how could AI help with each of those steps?

Starting with point 1, I don't think many people are using AI to create content, so a pretty key point is: did you create good content for the AI to have fun with in the first place? And this is my first anxiety: 

If you're an AI-powered product, and you don't have a good rationale for why your content is better than someone else's, then why should I believe your AI is going to change that? 

AI can't (yet) turn a bad module into a good one: it's not rerecording videos with better analogies, or more succinct summaries, or whatever. Some might argue that AI can help pick the preferred content type for the specific student, but that sounds a lot to me like learning styles, and I've read enough Daisy Christodoulou to be highly sceptical as to whether that's a thing.

Moving to point 2, I guess you could make a case for AI somehow informing the sharing process, but I don't see that happening anywhere in practice. Rather, people build software, and they make tonnes of choices that are then hardwired into the learning experience, which may end up mattering more than anything their AI does. Stuff like: 

  • how you log in
  • what the user interface looks like
  • how quickly pages load
  • how many clicks are needed to move between pages

Why does that matter? Well, in a recent conversation about Carousel (the quizzing platform I've co-founded) recently, an esteemed academic made the excellent point to me that the biggest difference we can make is to get someone who previously wouldn't have attempted a task to attempt it. Until then, I hadn't spent enough time thinking about how taking a student from "didn't bother" to "learned a thing imperfectly" is perhaps a more profound change than going from "learned a thing imperfectly" to "learned a thing well". And maybe the best way to do that is to make it so easy to use that even easily distracted (or low-resilience) learners give it a crack. 

So, the point is:

If you're an AI-powered product, by all means spend money on the AI, but don't forget to make the product good in all the non-AI ways that may end up impacting the learning experience too.

OK,  time for points 3 and 5. The reason why I'm lumping these together is because it's actually pretty important - and not always clear - as to whether an AI-powered product is intended to be a full curriculum product, or a revision / homework / supplementary learning tool. Now, just from a sales perspective, I think it's much easier to sell a revision/homework edtech tool than a full curriculum product, at least for the time being. But also, from a design perspective, your focus here makes a big difference to what you'd ask your AI to do. A full curriculum product is likely to significantly more complicated, with more types of content and tasks, each of which needs deep and careful thinking about how AI might help. On the other hand, if you're just a revision / homework tool, maybe your main "thing" is just questions (or videos, or pods, or whatever).

Either way, at this step the only things I can think of that the AI can do is:

  • sequence content differently
  • select different types of content (Learning styles!) 
Now sure, I can see a value in AI for sequencing... but is it transformationally better than a traditional, well-designed curriculum? I'm not convinced, yet. I guess the complexity and popularity of a course are  factors, too: there are some pretty great and well-thought-through primary maths curricula out there, so maybe AI can't add a tonne by suggesting a different sequencing. On the other hand, perhaps there's more fertile ground with more complex and less-universal areas such as A-Level Physics, for example. In any case, my point is:

If your AI is focused on sequencing content or selecting different types of materials, you need to be able to explain why this makes you more effective than a decent teacher.

Finally, let's think about points 4 and 6. Here's where I see the most potential for AI/ML. So much edtech revolves around multiple choice questions, because they're easy for a machine to mark, so I can see AI playing a major role in expanding the range of assessment types that computers can handle. Startups like Progressay (essay marking) and Lexplore (reading dyslexia assessments using eye tracking) interest me: the appeal is that I recognise the problem, and can understand - and therefore believe in - the role of AI. 

Another angle that AI/ML can help with is spaced repetition (i.e. how frequently, and at what interval, questions are asked and re-asked to help embed knowledge). This is something we've been thinking about a lot at Carousel, and we expect to introduce innovations in this area over the next year or so. This is something that really isn't intuitive to teachers; and even if it was, it's hard to have the discipline to remember to re-quiz students on a subject when you have so much new ground to cover. So I can see AI/ML playing a really useful role in the revision and embedding process. But, at the risk of repeating myself, this will only work if the content is well-designed, and your product is designed in a way that students actually want to interact with.

Finally, it's worth remembering that many of the Big Technological Leaps Forward we need to make in edtech can be achieved without AI/ML. I'm also co-founder of a MAT assessment platform called Smartgrade, built with input from the legends at Evidence Based Education. Smartgrade uses a bunch of algorithms to standardise common assessments, and also to feed back on how well designed they are. That's not AI/ML; but it is clever use of technology to automate and improve assessment accuracy. AI isn't the only way.

So in summary, I'm not saying AI can't help with edtech. Rather, I'm saying:

Your theory of AI will be most compelling if you can articulate which part of the learning process it tackles, and why that bit needs AI in the first place.