Building Blocks for a Successful Verification Process of a Tier1

Building Blocks
for a Successful Verification Process of a Tier1 ECU
MOST Forum, Stuttgart/Esslingen, May 13th, 2014
Dr.-Ing. Terezia Toth
Head of Compliance Laboratory / Senior Consultant Engineer
experts in automotive data communication
www.ruetz-system-solutions.com
Agenda
1. Motivation
2. Test House as a Service
3. Test Case Development
4. Test Example
5. Benefits
experts in automotive data communication
2
www.ruetz-system-solutions.com
Motivation
Tier1 supplier new to MOST Technology
• No reference for benchmarking
• Missing know-how (standards, OEM req.)
• Tight time schedule of project
 Tier1 supplier needs fast ramp up
• Know-how
• Staff
• Development
• Quality management, test infrastructure
experts in automotive data communication
3
www.ruetz-system-solutions.com
Motivation
Typical Situation of Tier1 Suppliers
Tier1 Supplier
Test Execution
Test Execution
OEM
Device
Test Report
Test Report
C
D
experts in automotive data communication
?
W
Validation?
P
B




Q
A
K
Requirements
4




www.ruetz-system-solutions.com
Motivation
Tier1 supplier needs
Quality management
• Simple method for system verification
• Effective feedback reg. test results
• Regular reporting to OEM
• Project status
• Key performance indicator
Test infrastructure
• Test equipment
• 100% coverage of requirements
• Regression tests
• Test cases reg. robustness, availability and error handling
experts in automotive data communication
5
www.ruetz-system-solutions.com
Agenda
1. Motivation
2. Test House as a Service
3. Test Case Development
4. Test Example
5. Benefits
experts in automotive data communication
6
www.ruetz-system-solutions.com
Test House as a Service
Role Allocation
Tier1 Supplier
develops control units,
not test processes and tools
OEM
specifies functionalities and verifies
the successful implementation
Test House as a Service
concentrates on detection of implementation errors and
supports OEMs and suppliers with the integration
experts in automotive data communication
7
www.ruetz-system-solutions.com
Test House as a Service
Test coverage
Tier1 Supplier
Test House as a Service
20%
New tests
80%
experts in automotive data communication
100%
coverage
Tests available
8
www.ruetz-system-solutions.com
Test House as a Service
Process Support
Reliability through
Reporting
• KPI
• Req. mapping
• Req. coverage %
• Statistics
• Test reports
• Tickets
OEM
Requirements
Tier1 Supplier
ECU
Development
Test House as a
Service
Test,
Test Development
Tester <-> Developer
• Debug
• Effective feedback
• Reliability
•
Scrum – if necessary
experts in automotive data communication
9
•
•
•
•
Integrated in Tier1’s
process
Know-how
Begin at early stage
of ECU development
High quality
www.ruetz-system-solutions.com
Test House as a Service
Statistics of test automation
experts in automotive data communication
10
www.ruetz-system-solutions.com
Agenda
1. Motivation
2. Test House as a Service
3. Test Case Development
4. Test Example
5. Benefits
experts in automotive data communication
11
www.ruetz-system-solutions.com
Test Case Development
Requirement Analysis, Review of Documents
• Check of requirement definitions
• Early identification
Test
Specification
of incompleteness saves effort later
compile
Test case definition
Test Suite
• Approved test specification process
TCI
TRI
• Including realistic use cases
Behavior
Components
Types, Data
Ports
Timer
System Adaptor
Codecs
Component
Handling
• Know-how and best practice
apply
Test Management
Control
Platform Adaptor
System Under Test (SUT)
Execution
• Experience from 15 years
of system integration testing
analyze
Report
experts in automotive data communication
12
www.ruetz-system-solutions.com
Test Case Development
Ruetz Building Blocks help to develop the missing test cases
Test Case A
Test Case B
MOST
Compliance
Tests
Test Case C
Test Case XY
Test Case XZ
Test Case YZ
RUETZ Test
Suites and
Test Cases
RUETZ
Building
Blocks
for new
Test Cases
experts in automotive data communication
Minimum effort for 100% coverage
• Rational test automation
• Automation for regression tests
• Focus on progress of ECU
development
13
www.ruetz-system-solutions.com
Agenda
1. Motivation
2. Test House as a Service
3. Test Case Development
4. Test Example
5. Benefits
experts in automotive data communication
14
www.ruetz-system-solutions.com
Test Example
How to test a complex behavior including
•
CAN-MOST Gateway
•
Timing
•
DTC
CAN
UDS
ISO TP
MOST
DUT
MHP
trigger
simulation
error injection
timing
analysis
Tester
• Adapter for the OEM specific OBD tool
• Use of Ruetz Building Blocks: UDS, ISO TP, CAN, MHP
experts in automotive data communication
15
www.ruetz-system-solutions.com
Test Example
MHP
DUT
ISO-TP
Last Frame
Frames with
payload 00..FF
!
!
All ISO-TP msgs in 1 MHP msg
experts in automotive data communication
16
www.ruetz-system-solutions.com
Agenda
1. Motivation
2. Test House as a Service
3. Test Case Development
4. Test Example
5. Benefits
experts in automotive data communication
17
www.ruetz-system-solutions.com
Benefits
Confidence through transparency
• Initial tests ready for execution on demand at Test House
• Testing of DUT variants without any delay
• Well-approved Tools and Processes
• Professional Training, Support and Maintenance
• Tests can be executed in-house at Tier1
ECU meets OEM and MOSTCO requirements
experts in automotive data communication
18
www.ruetz-system-solutions.com
Benefits
Documented project state to any given time
• Considered requirements
• Mapping of requirements and test cases
• Tickets
• State of the test case development
• State of the change requests
• State of the DUT
Project can be monitored and conducted precisely by Tier1
experts in automotive data communication
19
www.ruetz-system-solutions.com
Thank you for your attention!
Dr.-Ing. Terezia Toth
Walter-Gropius-Straße 17
80807 München
Germany
T +49 / 89 / 200 04 13-0
F +49 / 89 / 200 04 13-99
[email protected]
experts in automotive data communication
20
www.ruetz-system-solutions.com