A Data61 collaboration is seeing the construction of a tool that uses machine learning and citizen science to take the guesswork out of animal spotting.
Person holding phone up to take a photo of spider to add to Critterpedia

Critterpedia uses an algorithmic solution to identify the species of spider or snake submitted by users.

“Hey CSIRO, what bug is this?” It’s a question we often hear. And, in a country home to 170 species of snakes and 2000 kinds of spider, it’s easier asked than answered.

So where do you go when you want the details on what’s creeping and crawling near you?

A collaboration with Data61 is seeing the construction of a tool that uses machine learning and citizen science to take the guesswork out of animal spotting.

A bug’s life

Nic and Murray Scarce know the benefit of being able to identify Australia’s wildlife.

“During one of her trips to Australia, my mother-in-law acted as a magnet for all of the country’s big-name insects,” jokes Mr Scarce. “The questions relating to their identification and danger levels were relentless. And, the fact that we didn’t have all the answers simply exacerbated the situation.”

They found that an online search failed to provide all of the facts in one place. Thus, the idea to create an instant identification app was born.

Enter: Critterpedia

The tool allows users to take photos of a snake or spider from their smart device. A system trained with an algorithm then classifies it, providing information on the family, genus or species.

The artificially intelligent (AI) platform considers not only these images, but also additional information, like GPS location.

To teach the platform, hundreds of thousands of images of snakes and spiders were fed into the system. It was a sizeable task uniquely perfect for an AI solution.

“The visual differences between the two species can be quite subtle. We need a great deal of training data to adequately identify critters,” explains project lead and Data61 researcher Dr Matt Adcock.

The application aims to provide education and awareness for all Australians. And, as a wildlife safety tool, could ultimately save human and animal lives.

For the full version of this article head on over to our Algorithm blog.

14 comments

  1. Took a photo of a Tiger Snake. System responded with a Daddy Long Legs…

  2. Good! link to download this app please. Thanks

    1. Hi Parveen, you can currently sign up to become a Phase 1 tester, which lets you download a beta version of the platform and submit wildlife photos to keep training the algorithm. More information is available here: https://critterpedia.com/phase-one-testers/

      Thanks,
      Georgia
      Team CSIRO

  3. I am always searching reference books for the particular spider, cricket, insect I’ve found. This looks great

  4. I would love to help construct the database using my local FB and Landcare groups. In particular also a version focused on our Locality Tamborine Mountain and then add other critters like crickets snails centipedes using our groups for reference inputs?

    1. Hi John,

      Thanks for your comment. For more information on Critterpedia and to get in touch regarding this idea please visit their website: https://critterpedia.com/

      Thanks,
      Georgia
      Team CSIRO

  5. I don’t like the American term bug for an insect. Bugs are a specific Order of Insects with sucking mouthparts. Critters is worse!

    Dr Roger Farrow Author of Insects of southeastern Australia (CSIRO)

What do you think?

We love hearing from you, but we have a few guidelines.