The Fish Face project is in its final phase, and the first Fish Face unit has now been successfully installed on-board a fishing boat in Kupang, Indonesia! Amir from Refind struggled with everything from expected challenges like lack of electricity and internet connectivity availability, to more unexpected problems like cable-chewing mice and timing of the tide.
Since July the Fish Face Unit has been used at a local fishery site in Kupang to collect images of different fish species in order to build up a large database of the local fish species. Thousands of images have been collected and there is a first “classifier” installed now - able to recognise about 65 different fish species. This software will be updated continuously along with an increased number of collected images.
The Fish Face Unit was, as planned, installed on the deck on a local fishing boat. Deck space is very limited and so is the access to constant electricity or internet. We have solved this by adding a power supply and a cloud based data storage solution to which information can be uploaded when possible. The activity of classifying fish is not real-time dependant and can be performed when possible. The geographical location tagging will however be done at the actual time when the photo is taken, so the GPS data collected is not depending on internet access.
All classifications are stored with their species name and GPS tags, and we have also added the possibility to do quality checks by connecting to a webpage where the latest classifications can be viewed. This will give both fishermen and the staff of The Nature Conservancy a transparent and easy process to overview and improve the performance.
In the table above the classifications are listed and an image is shown from the actual Fish Face unit next to the label image of the classification performed. Later on a segmentation functionality will be added, where the fish length will be calculated. The system also allows for handling input from many different image sources (boats).
The next phase of the project will focus on evaluating the equipment and overall solution, and aim to expand the project into installing more camera units on more boats and expand the operations.