1000 - Challenges implementing noise mapping standards in software

This project is financed by
the European Union and the Republic of Turkey
TR2009/0327.03-01/001 Technical Assistance for
Implementation Capacity for the Environmental Noise
Directive (EuropeAid/131352/D/SER/TR)
Çevresel Gürültü Direktifinin Uygulama Kapasitesi için
Teknik Yardım Projesi
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
Challenges Implementing Noise Mapping
Standards in Software
Simon SHILTON, Key Expert 2
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Overview
•
•
•
•
Implementing noise standards in software
Good practice
Emerging solutions
Conclusions
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
IMPLEMENTING NOISE STANDARDS
IN SOFTWARE
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Multiple methods
• Many noise calculation methods have been
developed, including:
– General: ISO 9613-2, Harmonoise, MSZ 15036
– Road: RLS 90, DIN 18005, RVS 3.02, NMPB/XPS 31-133, CRTN (L10 and
LAeq), UT2.1-302
– Industry: VDI 2714/ 2720 /2571, DIN 18005, DIN 18005, ÖAL 28, BS
5228, DAL 32
– Rail: SCHALL 03, DIN 18005, AKUSTIK 04, TRANSRAPID, ÖAL 30
(ÖNORM S 5011), CRN, RMR/SRM II, RLM2/ISO, MSZ 2904
– Aircraft: ECAC 29, AzB, AzB-L, DIN 45684, LBF
Preparation of Environmental Noise Models – 20 February 2014
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
This project is financed by
the European Union and the Republic of Turkey
Challenges
• In most cases there is no official helpdesk available for software
developers to call upon to ask questions on the standard
• The team which originally developed the (paper) standard has
often been dissolved and has no funds for further support.
• Implementing the standards into software brings two major
challenges:
– Interpreting the method.
• Most noise calculation methods are not specific enough and not clear
enough for reproducible software implementation. They contain unclear
phrases and ambiguous algorithms.
– Using general purpose GIS data.
• The current standards give no guidance on how to convert general
purpose GIS data into noise calculation data suited for the algorithms of
the standard. Also in the standard only simple idealized case are
described such as an infinite thin barrier.
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Implementation
A prediction standard is:
• described on paper
and laid down in a law,
standard, a norm or a
guideline
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Standard
Interpretation
Software
(recipe)
(cook)
(dinner)
A prediction standard is
not:
• computer software
Computer software is
always an interpretation
of a paper document.
Two software programs based on the same standard may
not necessarily give the same results.
(Different cooks cook differently)
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Support for methods
• Situation in 2001
• Some have improved,
others have remained
the same
• A means of clarifying
unclear text in a clear
and open forum is
required
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Basis of the standard
• Standards are developed for different purposes and thus are more or less
limited in their scopes.
– For example, the UK road traffic noise calculation standard CRTN 1988 was
designed for noise insulation grants >68 dB L A10,18hr and <300m from the main
noise source. It is therefore likely to be less accurate at lower noise levels and
greater distances.
– ISO 9613
• “predicts the equivalent continuous A-weighted sound pressure level … under
meteorological conditions favourable to propagation from sources of known sound
emission. … These conditions are for downwind propagation, … or, equivalently,
propagation under a well-developed moderate ground-based temperature
inversion, such as commonly occurs at night. Inversion conditions over water
surfaces are not covered and may result in higher sound pressure levels”.
• When calculating ground effect “is applicable only to ground which is approximately
flat, either horizontally or with a constant slope.”
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Propagation paths
The engineering methods often
describe simple paths
•
Type 1 – Diffraction
•
•
Type 2 – Reflection
•
•
Not always over multiple
screens
Not always for multiple
reflections
Type 3 – Lateral diffraction
•
Often not described
But do not describe complex
paths
•
•
Type 2 - reflection plus
diffraction
Type 4 – reflection plus lateral
diffraction
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Complex 3D geometry
• Complex geometries
requiring 3D path finders
• However the complex
paths described are not
specifically described
within the standards
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Expectations
• The real world is more complex than the simple test
cases within the standards
• Detailed 3D model input data produces many
complex situations where the user wants/needs to
produce an answer
• The methods do not describe how to make the result
in such a case, however users will not accept a “no
answer” result
• The methods are thus frequently being used beyond
their design scope, with software developers having
to extend the range of application to meet the
expectations of the users
• Who is responsible?
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
GOOD PRACTICE
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Good Practice
• The major factors affecting good practice:
– the clearness of the documentation of the standard
– documentation of software functions and its implementation of the
standard
– quality assurance of software implementation
– documentation of software settings in calculation results
– the user’s knowledge of the standard
– the user’s knowledge of the software
– the user’s analysis of the quality and impact of the input data
• Legislators, method developers, software developers and users
share responsibility for result quality & must follow good practice
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Good Practice: Legislators & Method Developers
• Develop test cases and document the standards
– Improves knowledge on scope and accuracy of the standard, enables a
better and less variable implementation of the standard in software,
giving more repeatable results
• Develop test cases and correct documentation of standards
during the development and selection of new methods
– Improves knowledge on scope and accuracy of the standard, enables a
better and less variable implementation of the standard in software,
giving more repeatable results
• Recurring user certification of environmental noise assessors
– Some countries such as Denmark require recurring user certification of
environmental noise assessors for use of their work, including results
from their calculations in legal issues
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Good Practice: Legislators
• Guidance on input data collection and use in different applications:
– Specifications for GIS input/output data and data collection
– Specification on degree of detail of the input data tailored for different noise
mapping needs, e.g., strategic (global) noise mapping versus detailed (local)
noise mapping for action planning
– Standard scheme for the collection of information on the datasets used and
processing procedures used
– Specific conditions related to the definition and usage of “default” input data
• Set up guidance on the competent use of noise assessment
methods:
–
–
–
–
–
The relevant quality and quantity of input data
Guidance on how to use, extract, extrapolate and manage input data
Software calculation settings
Software use and modelling
A fixed methodology to attribute population exposure to noise levels
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Good Practice: Software developers
• Adequately documents the software’s functionality
• Document how the standard is implemented in the software
• Provide test case models from standards, where applicable, as part of
standard software package
• Comply with software QA and verification methods such as the Nordic
method
• Improve quality and extent of guidance and advisory documentation
– matches the most frequent use situation
– Properly describes various users controlled calculation settings, including
risks of misuse
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Good Practice: Software developers
• Reports of compliance results against test cases should
include software calculation settings used:
– Ensures that results can be repeated
– Initial guidance on which settings are required or recommended for
different tasks should be supplied provided
• NOTE: The user has final responsibility for choice of settings
depending on requirements to calculation accuracy (and
calculation time) however they should be well informed
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Good Practice: Users
• Read the Standards!
• Which input parameters influence results the most and in what
situations?
–
–
–
–
Consult WG-AEN Good Practice Guide v2
Consult national guidance e.g. for Dutch railways, French roads
Consult conference papers on experiences & accuracy implications
Test effects of simplifications using the software and selected method on
typical or actual cases
• Gain knowledge of the standard to determine if and how best to
simplify model input data without undue loss of accuracy
• Investigate the calculation method’s sensitivity to input parameter
variance
• Visually inspect the results, are they plausible?
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Good Practice: Users
• Knowledge of how calculation settings affect the performance
of the software…………………………..………..but
• Know also how they affect results!
– Read the software’s manual
– Attend initial training offered by the supplier
– Perform tests on the effects of simplifications using one’s software and
selected method and on typical or actual cases
– Produce difference maps for different settings against a reference
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Good Practice: Users
• Develop (additional) test cases
– Test cases where multiple models with different levels of detail of
input data can be compared in order to get an overview of the impact
of results
– Improves knowledge of the standard
• Compare results with noise measurements
– Compare results from measurements and calculations based on the
same situation……but remember uncertainty
– Improves knowledge of the standard
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
EMERGING SOLUTIONS
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
ISO/TC43/SC 1 WG56
• Draft ISO standard 17534
– Aims to improve:
• Accuracy – approaching the correct calculation in agreement with
the published method
• Precision – reducing the spread of results obtained when using
different software products
– Sets responsibilities on:
• Authority who develop standard to provide clear unambiguous
text and documented test cases
• Software developers to provide certification of test case results
and explanations for any variations
– Benefit to market with improved confidence
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Authority
• Suggested that the group developing a standard should:
– be a cross discipline collaboration: acousticians, mathematicians,
software developers and data experts
– provide the digital models and source code of the software (if
applicable) used for the validation
– provide test cases with idealised data and non idealised multipurpose
GIS data
• The authorities should:
– set up a helpdesk on the method for users and software developers
– publish additional guidelines and regular updates of the method
– provide a way of validating conformance of the software with the
method, such as the Nordtest method
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Nordtest
Conformance of noise
software
Preparation of Environmental Noise Models – 20 February 2014
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
This project is financed by
the European Union and the Republic of Turkey
Authority/Legislators
• Technical Report
– Ambiguous aspects of standards may be addressed in a
technical report under the standard
– May be produced by Legislators or software developers if
Authority committee no longer behind the standard
• “Test city” proposed to be made available for round-robin
testing
• NOTE: It is currently a draft, NOT an approved standard, it
may change, possibly significantly
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
DIN 45687 Test City
“QSDO”
Based upon the city of Dortmund in
Germany
• Falsified terrain model
• Buildings, roads and bridges
normalised for equivalent
treatment in each several software
tools
• Available in QSI interchange
format defined in DIN 45687
• RLS90 road method used as basis
• Basis of “anonymous” round robin
testing hosted by DIN
Following 2nd iteration small number
of significant variations which are
being discussed within the DIN
working group
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
CONCLUSIONS
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Conclusions
Preparation of Environmental Noise Models – 20 February 2014
This project is financed by
the European Union and the Republic of Turkey
Technical Assistance for Implementation Capacity for the
Environmental Noise Directive
EuropeAid/131352/D/SER/TR
Thank you for your attention
[email protected]
Preparation of Environmental Noise Models – 20 February 2014