Three new species (Blue Tit, Winchat and Stonechat) have been added to the EBP viewer. These species were already among the 105 target EBP species but have remained hidden due to some technical problems with the data.
Due to their contrasting migratory patterns, the Winchat and the Stonechat are a nice pair to be seen in the EBP viewer
Data from Croatia has been added to the EBP viewer
The EBP viewer maps have been updated to show the data from Croatia. With this later addition, currently the EBP viewer is already showing information of all EU Member States except three (Lithuania, Malta and Slovenia).
Most of the data has been collected since 2015, when the local ornitho portal was launched, but there are some records from previous years. Currently, the portal is collecting more than 20,000 records a year.
12 countries already submitting data automatically to the central EBP data repository
The automated data flow implementation keeps advancing. Currently we are already receiving data in near real-time from 12 different countries and three online systems: BirdTrack, Ornitho and Aves Symfony. All them submit data automatically to the EBP central repository on a daily basis and updated up to the previous day.
The beta version of the real-time EBP viewer is also automatically updated and almost live visualizations of the latest bird movements can already be seen (see GIF shown below). This new version of the EBP viewer will be accessible to EBP partners in brief.
This August movements of species like the Yellow Wagtail and the European Honey Buzzard can easily be appreciated in the beta version of the new real-time EBP viewer.
At the start of the 24-hour challenge there were 122 birdwatchers (32 teams) that struggled with tiredness, insects and heat - all to see as many species of birds as possible.
All species detected were submitted to ornitho.pl portal or NaturaList app. The winner team recorded 165 species, which is probably the Poland record. 14 teams with 50 observers in total decided to collect data in complete lists. In total they submitted 91 lists with 187 bird species.
This year Poland is collecting 35% more complete lists than the previous one and 2,6 times more than in 2010. A great step foward in terms of data quality!
Distribution of records collected during the 10th Big Day in Poland in May 2018
Promotion of complete lists and participation in Spain: we keep growing!
So far, the data collected in Spain has shown to be insufficient for most of the species and large areas of the country. This can easily be seen in the EBP viewer maps, where gaps of information in some parts of Spain are still quite obvious. Gaps that a campaign undertaken with the help of LIFE EBP funds during 2017 intended to correct by means of increasing participation in areas previously poorly surveyed as well as promoting the collection of complete lists.
The campaign, undertaken by SEO/BirdLife, was focused on the dissemination of eBird Spain, already launched in 2015, among volunteers, partners of the organization and ornithologists in general. For this purpouse, the following activities were carried out:
Organize talks and courses.
Undertake dissemination activities in several key events (Bird Fairs and Bird Days).
Organize meetings with the reviewers and coordinators of eBird Spain to extend the network of reviewers and the dissemination of the system to more regions.
The second phase of implementation of the automatic data flow has started
To automate the data flow between the different local online portals and the central EBP database repository is one of the key tasks to be done in the framework of the LIFE EBP project.
A JSON schema and API solution has been developed to encode and transfer the data and already applied to connect two of the more widespread online systems within the EBP partnership (BirdTrack and Ornitho), which provide c.60% of all the project data.
Now, the second phase of the implementation of the automated data flow has started, aiming at connecting a further 10 online systems or, at least, the equivalent of more than 80% of all data collected by the EBP partnership.
At the local online system side, there are various tasks that have to be conducted:
1. Preparation work
Data aggregation (10x10 for casual data).
Unique id’s generation.
Create methods to handle updates and removals.
Map the species codes.
Map the breeding evidence codes.
2. Basic data provision testing
Implement Oaut2 client to access to the API.
Start with simple data provisions in Test Mode (T).
Determine protocol data and define protcols.
3. Standard data flow integration
Create Standard Mode (S) data provisions with real data.
Create cronjobs or equivalent to send data as periodic tasks.
Test removals and past modifications.
4. Data flow with standard
Send old data in Bulk Mode (B) in chunks. (optimal provision size should be determined).
Complete instructions, with a detailed API documentation and specifications as well as a specific website have been prepared to facilitate the work of the partners. Moreover a test submission mode has been developed so that partners can try the connectivity before submitting real data.
Meeting with the colleagues from ArtDatabanken regarding the automated connectivity between Artportalen and the EBP central database repository
A specific website have been prepared to facilitate the work of the partners
There were two main reasons behind the decision of developing a new version of the viewer. On one hand, the partnership increased largely, particularly in 2017, thanks to the participation of the key ornithological institutions in Bulgaria, Croatia, Cyprus, Estonia, Greece, Hungary, Romania and Turkey and their respective online portals. This meant that the geographical area shown in the previous version of the viewer was far too limited to properly show the data collected by the new partners. Moreover, the increase in geographical coverage would require also doubling the capacity of the current cloud mapping and database repository that handles the processed data used to visualise the animated viewer maps.
On the other hand, it was required to adapt the old version of the EBP viewer to the much higher updating frequency expected to be put in place by the end of 2018, when a new data sharing standard, automated data flow and database repository will be fully functional. Up to know, the data has been uploaded to the viewer once a year and the whole data flow has been managed on a manual or semiautomatic basis (the partner’s datasets are not directly connected with the central EBP data repository). By the end of the year, thanks to these new technical developments the content of the EBP viewer will have to be updated at a weekly basis and showing data up to the previous week.
Finally, this new version is fully responsive and tablet and mobile friendly, allowing people to enjoy the EBP maps from a much bigger array of devices than previously.
The new version of the EBP viewer can also be enjoyed from mobile devices
The EBP data flow is starting to work on near real-time
To be able to updated in near real-time the EBP viewer by the end of the year (a key objective of the LIFE EBP project), it is vital to automate the data flow between the different local online portals and the central EBP database repository. And this is the main objective of LIFE EBP project Action A6.
The task is advancing well and currently the BirdTrack and Ornitho online systems are already connected to the central EBP database repository. This is particularly important since these two systems collect c.60% of all the EBP data and the experience gained with them will be very useful for the next stages of development of this action.
Furthermore, we have developed a real-time test viewer (the basis of the future version of the EBP viewer) that is already working with the data submitted by BirdTrack and Ornitho in near real-time. The results are promising and we expect to put the beta version of this viewer available to the EBP partners during early summer.
The EBP real-time test viewer is already showing fresh data from BirdTrack and Ornitho
The occurrence map of Eurasian Golden Oriole as seen in the EBP real-time test viewer using ornitho data from this spring
online portal used by naturalists in Belgium is the multilingual www.waarnemingen.be/observation.be
(of the global www.observation.org
family). Since its launch in 2008, it generated 29 million records of over
20,000 species (the portal accommodates all taxa). Most records have
traditionally been casual observations, resulting in presence-only type
data. Making complete lists was possible online since 2012, but never became
more than 50% of observations are registered using mobile phones (80% Android).
Hence, a smart and easy check-listing system was developed linked to track
recording in the app ObsMapp (for Android). With the support of the Life project EuroBirdPortal,
listing of at least all species (but whenever possible also all individuals)
was promoted from spring 2017 in various ways, but principally by repeatedly
raising awareness amongst observers of the value of check-list data and of the
ease to produce them in ObsMapp. There were some 20 announcements, e.g. as news
items on the website, in electronic newsletters, on social media and publications
in bird journals. The number of lists collected is now also shown as part of
the daily statistics on the home page. The promotion of complete lists became a
standard item in courses, talks at symposia and webinars. The top100 ranking
observers (responsible for 42% of all bird data) were contacted individually
with tailor made advise on how to improve their data by listing and track
recording. Making lists is also one of the criteria in the 10-year
waarnemingen.be anniversary competition (with daily personal stats shown on the
The home page incorporates now also daily statistics on lists, tracks and
pointcounts (e.g. 6 May 2018)
campaign doubled the flow of lists in a few weeks. The number of records
attached to lists increased from 3,2% in 2016 to 10.6% of all records in 2017. Listing
linked to track recording in ObsMapp quickly became the principle way of producing
lists (It is now also being built in iObs for iphone). The number of lists
shows a strong annual cycle, with almost 10 times more lists in spring and
early summer. That is mostly because this is a multithematic portal and listing
of e.g. butterflies, dragonflies or bees ceases in winter.
The promotion made listing linked to mobile track recording with ObsMapp
popular (more than one taxonomic group can be listed simultaneously)
analyses of bird lists demonstrate their usefulness. For example, outbreaks of Usutu
virus affected birds in parts of Belgium in summer 2016 and 2017 for the first
time. Blackbirds were particularly badly hit. Because there is no close link in
such abundant species between the number of observations and the number of
incidental records being reported to the portal, incidental observations cannot
be used directly to investigate the impact of Usutu, other than as an indication
from the higher number of dead or ill birds reported that there was a problem
and when it occurred (dotted lines in the figure). There were more dead or ill
birds reported in 2017 and they occurred a month earlier than in 2016.
Even though the number of lists is not all that large yet (and therefore graphs are not very stable), it already gives a much better indication of the impact of Usutu: during the first limited outbreak in only a small part of the country in 2016, the reporting rate of Blackbirds dropped by some 15% in August-September 2016. Reporting rates remained 10% lower throughout spring 2017, but crashed by more than half during a more severe and more widespread outbreak in July-August 2017. Reporting rates recover in autumn with the arrival of Scandinavian migrants, but in spring 2018 reporting rates drop again some 10% lower than in 2017.
Reporting rates of Blackbirds in complete lists in Belgium by week and the
number of birds reported dead or ill in 2016-2018 after outbreaks of Usutu
A contribution by: Marc Herremans, Kristijn Swinnen, Elke Leys and the observation.org programming
The 12th EBP meeting and the third LIFE EBP coordination meeting took place in Portugal
The 12th EBP meeting took place in Évora, Portugal, on April 12-13th 2018. A total of 19 persons from 11 different countries attended the event this time.
The attendants of the 12th EBP meeting at the University of Évora, Portugal
The progress of the automated data flow implementation (LIFE EBP Action A6) was one of the key points of the agenda. The data flow implementation and data provision structure (JSON structure) was described in detail and the kind of work that has to be done at both ends of the data flow (i.e. the local portal and the central data repository) was also introduced.
After starting with the connectivity with BirdTrack and ornitho, now the second step of Action A6 (i.e. implementing the automatic data flow mechanism for around a further 10 online systems or, at least, the equivalent of more than 80% of all data collected by the EBP partnership) will start. Due to budget and time limitations, the priority now would be to connect those systems/partners already in the partnership when the LIFE project started (the main target of this Action) and those operating in more than one country.
The overal progress of the LIFE EBP project and the potential outputs of the project that could be of interest for the European Commission were other important issues discussed in the meeting.
The Senate room at the University of Évora, a fantastic location for the EBP meeting
Just before the general EBP meeting, on April 12th in the morning, 9 persons participated in the third meeting of the LIFE EBP coordination team.
The attendants of the third LIFE EBP coordination meeting
were particularly encouraged
to collect complete lists, explaining the relevance of this kind of data and
hightlighting that, thanks to the improvements in the Davas dati app, now
submitting complete lists was easier than ever.
to use the option of complete lists was also published in the magazine of the
Latvian Ornithological Society (LOS) “Putni dabā” and in the methodology of the EBBA project in Latvia.
Moreover, the importance of submiting this complete lists was also presented to
the participants of the annual meeting of LOS members.
were 2,027 full lists reported during 2017 (287 using mobile application and
1,740 through the web), containing 48,555 observations (8,267 as mobile uploads
and 40,288 through the web).
planned to publish a new appeal in Dabasdati.lv in a few weeks to further remind
about the importance of collecting complete lists.
Dabas dati improves by allowing the reporting of complete lists through its mobile app
the help of the LIFE EBP project, the Latvian online portal Dabas dati will be
collecting more complete lists. This has been possible thanks to a series of
improvements in its mobile app that makes reporting of complete lists easier and thus more attractive
to the observers.
activate the recording of a complete lists in the Dabas Dati app all is needed
is to press a button (Saraksta veidošana).
indicator appears showing that all observations will be added to the list. At the end of the
observational event, the user selects the “Stop” button to end the list. Observations
are syncronized with the online portal as soon as the list is finished.
also possible to add a name to the list to make finding of relevant
observations in the web easier.
start and end time are filled in automatically. Moreover, the user can indicate
whether all individuals were counted or not. It is possible to edit
observations while the list is active.
other improvements were also made, including adding the possibility to switch
the background map to orthophoto and making the location of the buttons more user
The new version of the EBP viewer is already online!
Today we are pleased to release an improved version of our viewer: now bird movements across Europe can be visualized in a way never seen before.
This new version of the viewer has also been updated with 40 million more new bird records collected in 2016 and now shows animated all-year round maps of 105 bird species for a period of seven years, ensuring that the EBP maintains its position as the largest and most dynamic citizen science biodiversity data flow in Europe.
This improved version of the viewer also incorporates a new visual design and several new functionalities, including zooming and embedding options (see an exemple just below these lines). Moreover, the extension of the area covered by the maps has increased markedly thanks to the incorporation of data from Bulgaria, Cyprus, Estonia, Greece, Hungary, Israel, Romania and Turkey.
All these improvements have been possible thanks to a LIFE preparatory project (LIFE15 PRE/ES/000002 / 2016-2018) granted in 2016 by the European Commission.
We hope that the new improved version of the EBP viewer will help highlight the value of the data collected through the online bird portals operating in Europe and the relevance of sharing bird observations. The EBP main objective is to unravel the seasonal large-scale patterns of bird distribution in Europe, but this can only be possible thanks to the contribution of 100,000 volunteer birdwatchers that share their observations in the online portals and by the efforts of EBP partners to combine this huge amount of data in a sound and structured way.
Thanks to these combined efforts we are in a better position to understand changes in bird migration patterns, like the new route followed by Cranes in Southern Europe, or the influence of weather and climate on bird migration.
30 participants from 16 different countries attended the 11th EBP meeting in Barcelona
The 11th EBP meeting took place in Barcelona on November 13-14th 2017. This has been the meeting with the highest participation so far, with 30 persons from 16 different countries having attended.
The attendants of the meeting in front of the Museu Blau, Barcelona
The main topics
discussed in the meeting included the new version of the EBP viewer, the estate
of the Best Practices Guide, the progress of the LIFE EBP project and the role
of the SMOG (Spatial Modelling Group of the EBCC) in the EBP modelling approach.
the first elections to the chair of the EBP Steering Committee and the
Executive Committee took place. The elected members were:
Steering Committee: Gabriel Gargallo.
Executive Committee: Stephen Bailie, Ruud Foppen, Carlos Godhino, Károly Nagy, Jean-Yves Paquet, Hans Schmid and Peter Uppstu.
figures presented in the meeting highlighted the good progress of the project
in terms of data quality. Complete lists have increased by c. 25% annually
since 2010 and countries such as France doubled the number of lists from 2015 to
A workshop with modelling experts took place in Barcelona in October
The current EBP modelling approach is being re-evaluated taking into account the new data standard and the future updating periodicity of the EBP viewer. For this purpouse, a workshop with modelling experts from the SMOG, the Spatial Modelling Group of the EBCC, was organized in Barcelona on October 27th 2017.
The main objective of the workshop was to better plan and coordinate the subsequent work to produce the new model maps and automated scripts. The discussions were very fruitful and the first trials using EBP data will be conducted in the next few weeks.
The maps of the new EBP viewer have been redesigned to properly show the whole area covered by the project
During 2017 quite a few new institutions have joined the EBP initiative, allowing a large increase in the area covered by the project, particularly towards the east and southeast. To be able to properly show these new areas in the EBP viewer, a complete redesingn of its maps has taken place during the last months. The results will be shown to the public in late 2017, once the data from 2016 is uploaded and the new version of the EBP viewer is launched.
The new EBP viewer has been redesigned to properly show the new areas covered by the project (countries shown in yellow).
The database repository infrastructure design is being tested
A first design of the EBP central database repository infrastructure has been produced and some tests are being conducted using Amazon Web Services (AWS). In parallel, the work to design the protocol that will be used to encode and implement the automatic data flow from the local portals to the central database repository has also started.
All this work is part of Action A4, aimed at designing a solid, long-lasting and cost-effective database repository and data flow system, and one of the key tasks to be developed by the LIFE EBP project.
Corrected Regional Occurrence (CRO) maps have been updated with the data from 2015 and the 50 new species and are already available in the EBP viewer.
Modelling the spatial and temporal dynamics of bird distributions is one of the main but challenging objectives of the EBP project. This work is underway and, therefore, it has to be stressed that CRO maps are still very preliminary.
Note, however, that the data provided by these new partners will only be shown in the EBP viewer in late summer, once the viewer is updated with the data for the period 2010-2016 and the maps redesigned to properly show the new geographic coverage.
The new EBP partners (countries in green) will greatly improve the geographic coverage of the EBP project.
The workshop on Best Practices took place in Namur, Belgium
EBP partners and guests gathered in Namur (Belgium) on 2-3 March 2017. Jointly with a regular EBP meeting, a thematic workshop was organized in relation to the Life EBP project action A9, aiming at “Promoting Best Practices and implementing overall benchmarks and quality indicators”. A total of 27 representatives from 17 countries attended the event, organized by Natagora, the local EBP partner. It was a great opportunity to improve the quality of the data collected and promote the continuous improvement of the individual online portals themselves.
The meeting attendants at Mundo-n, Namur, Belgium.
New update of the EBP viewer increases to 20.6 million the number of map combinations available to choose from!
Today, the EBP demo viewer has been updated with nearly 50 millions of new data. Moreover, the number of bird species available in the portal has been doubled and the period of years extended to 2010-2015. This is a first visible output of the Life EBP project.
Currently, the EBP demo viewer depicts animated weekly distribution maps of 100 different bird species for six years (2010-2015). Moreover, a new type of map has been added, allowing the visualization of the overall seasonal patterns of bird distribution by combining the whole six years of available data. Since two animated maps of any species, year and type can be selected to be shown simultaneously for direct comparison, this means that after the new update more than 20.6 million different map combinations are now available to choose from! Ten times more than before.
Snapshot of the EBP viewer: two distribution maps combining all available years of data (2010-2015) for the Brambling and the Tree Pipit, two of the new species available after the new update.
The number of records collected by the on-line bird recording portals run by the EBP project partners reached a new record in 2015: 40 million! This means 19% more records than in 2014, and 140% more than in 2010. During the last 5 years, the recording activity has been increasing permanently, a pattern easily seen in the animated heat map shown below.
The new EBP data sharing standard has been finished
The new data standard has been designed in order to notably improve the opportunities for data analysis and modelling in the framework of the EBP.
The work on the new standard has been lead by SOVON following the main guidelines agreed at the specific workshop
held in the Netherlands during the 8th EBP meeting.
The new standard and the main differences with the previous one are detailed in (this document).
Note, however, that the final technical documentation will only be available once the definition of the data flow standard and database repository infrastructure
is completed (see Action A4).
The complete list module is already implemented in the ornitho app (NaturaList)
The Ornitho app has been improved with a set of new functionalities that allow recording complete lists in a simple and effective way. The Ornitho system operates in eight European countries and collects c. 50% of the data that is currently submitted to the EBP project, therefore, with this new version of the app we expect that the number of complete lists and, therefore, the overall quality of the data collected by the EBP partnership will increase significantly in the forthcoming years.
The list of 50 additional species has already been selected
The last EBP meeting was very fruitful and great advances took place in such important issues as the definition of the new EBP data standard or the selection of the 50 additional target species. Now the number of EBP target species increases to 105 (the initial 55 species already available in 2015 and the 50 additional ones).
The new list of EBP target species (the new 50 ones shown in red).
The meeting attendants in front of Villa Wylerberg.
More than 2.6 million different animated map combinations available after the 2014 update
The data from 2014 has been uploaded to the EBP demo viewer, notably increasing the number of distributional maps that are depicted. With this update, now the viewer allows free access to animated weekly distributional maps of a total of 50 different bird species for five years (2010-2014). With several map types available, this means that more than 2.6 million different animated map combinations are available to choose from.
Millions of animated map combinations like this are available in the EBP viewer.
The LIFE agreement among the beneficiaries has been signed
The LIFE agreement among the beneficiaries was signed on March 23rd.
Since the coordinating beneficiary and the associated beneficiaries are jointly responsible for carrying out the LIFE Preparatoty project and complying with the relevant legal obligations, the European Commission requires that the coordinating beneficiary shall conclude a LIFE partnership agreeement with all the associated beneficiaries.
The LIFE EBP kickoff meeting took place in Barcelona on March 1st-2nd 2016.
The meeting was attended by the coordinating and associated beneficiaries (CTFC, BTO, SOI, ICO, NATAGORA, SOVON) and the Commission LIFE technical monitoring team. The meeting was very useful to clarify some key administrative and financial aspects with the Commission, to review the project actions and to plan the work for the forthcoming months.
Our colleague Nicolas Titeux has been appointed LIFE EBP project coordinator. He has already been involved in the EBP initiative helping, for example, with reasearch-oriented issues such as the perspective paper and the modelling approach, and has a good experience dealing with big EU-funded projects (e.g. the EUBON project ).
Nicolas will be based at the Forest Sciences Centre of Catalonia (the Coordinating Beneficiary institution) and work closely with Gabriel Gargallo, the EBP project coordinator.
Nicolas Titeux, in the middle, at the EBP meeting held in Brussels in 2015.
A grant to develop the EBP viewer into a near real-time solution
The EBP has recently secured a LIFE preparatiory grant from the European Commission to develop the project entitled “Combining and improving online bird portals data to display near-real-time spatiotemporal patterns of bird distribution across Europe", known by the acronym LIFE Euro Bird Portal (LIFE15 PRE/ES/000002).
The project has a duration of three years (January 2016 to December 2018) and an overall cost of 510.557 €, of which 60% (306.334 €) are financed by the European Union.
The main specific objectives of project are:
1) To create a new EBP data sharing standard, database repository and data-flow system capable of managing automatically and in near-real-time all data interchange processes between the local online portals and the central databank.
2) Adapt and improve the current EBP demo viewer and the spatial bird distribution models in order to reliably display detailed and up-to-date European-wide spatiotemporal patterns of bird distribution in near-real-time.
3) Increase the geographical coverage of the EBP project to include most of the European Union (>90% of its territory).
4) Improve the quality and relevance of the data collected.