The Integrated Energy and Communication Systems Architecture

Volume IV:
Technical Analysis

 



 

 

 

 

EPRI Project Manager

Joe Hughes

Cosponsor

Electricity Innovation Institute Consortium for Electric Infrastructure to Support a Digital Society (CEIDS)

 

 

 

 

EPRI • 3412 Hillview Avenue, Palo Alto, California 94304 • PO Box 10412, Palo Alto, California 94303 • USA
800.313.3774 • 650.855.2121 • askepri@epri.com • www.epri.com



DISCLAIMER OF WARRANTIES AND LIMITATION OF LIABILITIES

THIS DOCUMENT WAS PREPARED BY THE ORGANIZATION(S) NAMED BELOW AS AN ACCOUNT OF WORK SPONSORED OR COSPONSORED BY THE ELECTRIC POWER RESEARCH INSTITUTE, INC. (EPRI). NEITHER EPRI, ANY MEMBER OF EPRI, ANY COSPONSOR, THE ORGANIZATION(S) BELOW, NOR ANY PERSON ACTING ON BEHALF OF ANY OF THEM:

(A) MAKES ANY WARRANTY OR REPRESENTATION WHATSOEVER, EXPRESS OR IMPLIED, (I) WITH RESPECT TO THE USE OF ANY INFORMATION, APPARATUS, METHOD, PROCESS, OR SIMILAR ITEM DISCLOSED IN THIS DOCUMENT, INCLUDING MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE, OR (II) THAT SUCH USE DOES NOT INFRINGE ON OR INTERFERE WITH PRIVATELY OWNED RIGHTS, INCLUDING ANY PARTY'S INTELLECTUAL PROPERTY, OR (III) THAT THIS DOCUMENT IS SUITABLE TO ANY PARTICULAR USER'S CIRCUMSTANCE; OR

(B) ASSUMES RESPONSIBILITY FOR ANY DAMAGES OR OTHER LIABILITY WHATSOEVER (INCLUDING ANY CONSEQUENTIAL DAMAGES, EVEN IF EPRI OR ANY EPRI REPRESENTATIVE HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES) RESULTING FROM YOUR SELECTION OR USE OF THIS DOCUMENT OR ANY INFORMATION, APPARATUS, METHOD, PROCESS, OR SIMILAR ITEM DISCLOSED IN THIS DOCUMENT.

ORGANIZATIONS THAT PREPARED THIS DOCUMENT

General Electric Company led by GE Global Research (Prime Contractor)

Significant Contributions made by
EnerNex Corporation
Hypertek
Lucent Technologies (Partner)
Systems Integration Specialists Company, Inc.
Utility Consulting International (Partner)

 

 

 

 

 

 

 

ORDERING INFORMATION

Requests for copies of this report should be directed to EPRI Orders and Conferences, 1355 Willow Way, Suite 278, Concord, CA 94520. Toll-free number: 800.313.3774, press 2, or internally x5379; voice: 925.609.9169; fax: 925.609.1310.

Electric Power Research Institute and EPRI are registered service marks of the Electric Power Research Institute, Inc. EPRI. ELECTRIFY THE WORLD is a service mark of the Electric Power Research Institute, Inc. All other trademarks are the property of their respective owners.

Copyright © 2002, 2003, 2004 Electric Power Research Institute, Inc. All rights reserved.

CitationS

This document describes research sponsored by EPRI and Electricity Innovation Institute.

The publication is a corporate document that should be cited in the literature in the following manner:

THE INTEGRATED ENERGY AND COMMUNICATION SYSTEMS ARCHITECTURE, EPRI, Palo Alto, CA and Electricity Innovation Institute, Palo Alto, CA: 2003 {Product ID Number}.


Executive summary

This is the technical analysis volume. It is based on the architectural principles introduced in Volume I section 3. Specifically it discusses in several concise sections and some large appendices the details of the analysis and technical results produced by the project.

To summarize, this volume discusses:

·         Architectural Principles                        Relates the principles introduced in Volume I to the specifics of the analyses detailing them herein

·         Architectural Analysis                         The high-level strategies used to solve the problem, the different environments, as well as common services, information models, and interfaces that were identified as the results of this analysis.

·         Technology Analysis                           A comparative analysis of the universe of technologies available and which are most closely aligned with IECSA requirements

·         Deployment Scenarios                         To identify common integration scenarios and detail how IECSA can be used to accomplish them.

·         Benefits and Conclusions                    A brief summary of the benefits from a technology and interoperability standpoint.

·         Appendices A..E                                  Detailed discussions of research by the team

Architectural Principles

This section reprises the levels of abstraction framework presented in Volume I. By successively abstracting the architectural analysis via these descriptions, the dominant aspects of architectural issues were exposed and detailed.


·         Business needs

·         Strategic vision

·         Tactical approach

·         Deployment scenarios


Architectural Analysis

A primary goal of the IECSA project is designing a common architecture for utilities. This section summarizes the principle modeling/analysis elements identified and applied in the IECSA

·         Requirements                                       Common industry requirements permit application constraints to be concisely and precisely defined.

·         Services                                               Refining applications into the services that can be combined in various ways to achieve functional goals.

·         Information models                             Common building blocks of information exchanged to accomplish applications.


·         Interfaces                                             Low level primitives that act as atoms to build the molecular common services of IECSA. The definition of these atoms facilitates the conveyance of the common services across environmental boundaries that may utilize different technologies.

Technology Analysis

This section summarizes the results of detailed analysis performed on the following important but often considered independent subjects crucial to collectively achieving a robust architecture.


·         Enterprise management

·         Data management

·         Platform

·         Communications

·         Security


Deployment scenarios

In deploying applications using IECSA, this section identifies the issues to consider and proposed solutions in performing integration.

·         Field Device Integration                       Shows how 61850 and DNP3 based SCADA systems can be integrated to provide unified rich model based device access and control.

·         Enterprise Management                       Encompasses the integration of a DMTF based Enterprise Management systems with TC 57 based utility systems.

·         Application Integration                        How a deployment of the CIM and GID can be used to create a platform for legacy application integration.

·         Data Analysis                                      As recovery of money spent on asset related operations is not guaranteed, it is critical that asset related costs be managed wisely.

·         Energy Market Integration                   Describes how a utility might integrate Energy Market Transaction Servers with utility operational systems.

Benefits and conclusions

This section briefly summarizes how IECSA facilitates the realization of the following benefits:


·         Reusable infrastructure

·         Interoperability through standards

·         Available off the shelf adaptors

·         3rd party applications

·         Extensibility

·         Incremental approach


What is in this volume

The following table identifies and summarizes the major sections in this volume:

 

Section 1 Principles and Requirements

 

The overall principles and requirements used to develop the architecture and a brief description of the problems it was intended to solve.

Section 2 Analysis

 

The high-level strategies used to solve the problem, the different environments, as well as common services, information models, and interfaces that were identified as the results of this analysis.

Section 3 Technology

Recommendations

 

Discussion of the implementation of the common modeling elements (services, information models, and interfaces) using specific recommended technologies within the defined set of environments.

Section 4 Deployment Scenarios

 

Guidelines and examples of how the architecture should be deployed by utilities.

Section 5 Benefits

 

Summarized the benefits of IECSA from a technical standpoint

Appendix A: Security

A comprehensive discussion of security considerations for energy industry and related communications

Appendix B: Network Management Technologies

A discussion of network management technologies and needs

Appendix C: Resilient Communication Services

Discusses those technologies and requirements that are necessary for robust communications networks.

Appendix D: Technologies, Common Services, and Best Practices

A detailed summary of all the individual technologies, common services, and best practices identified by the IECSA project

Appendix E: Environments

A detailed description of the IECSA environments

 

Contents

Executive summary.. iii

Architectural Principles. iii

Architectural Analysis. iii

Technology Analysis. iv

Deployment scenarios. 4

Benefits and conclusions. 4

What is in this volume. v

Contents. vi

List of Figures and Tables. ix

1. Architectural Principles and Requirements. 1-1

1.1 Enterprise Activities and Domain Use Cases. 1-3

1.2 Strategic Vision. 1-5

1.2.1 Data Management and Exchange Issues. 1-5

1.2.2 Abstract Modeling Tools. 1-6

1.2.3 Abstract Use Cases. 1-10

1.2.4 Domain Use Case Requirements Analysis. 1-13

1.2.5 Analyses of Abstract Use Cases. 1-20

1.2.6 Abstract Use Case Requirements Conclusion. 1-39

1.3 Tactical Approach. 1-40

1.3.1 Environments. 1-42

1.3.2 Technology Independent Architecture. 1-42

1.3.3 Technology Assessment 1-44

1.3.4 Architecture Conclusions. 1-45

1.4 Deployment Scenarios. 1-47

1.4.1 Enterprise Layering. 1-47

1.4.2 Migration. 1-49

2. Architectural Analysis. 2-1

2.1 Requirements Analysis. 2-1

2.1.1 Aggregated Requirements. 2-2

2.1.2 Domain Use Case Analysis. 2-7

2.1.3 Abstract Use Case Analysis. 2-7

2.2 Common Services. 2-33

2.2.1 Common System and Network Management Services. 2-33

2.2.2 Common Data Management and Exchange Services. 2-35

2.2.3 Common Platform Services. 2-37

2.2.4 Common Security Services. 2-38

2.3 Common Information Models. 2-41

2.3.1 Enterprise Management Common Information Models. 2-41

2.3.2 Power Systems Common Information Models. 2-42

2.4 Generic Interfaces. 2-44

2.5 IECSA Environments. 2-52

2.6 Conclusion. 2-53

3. Technology and Implementation Recommendations. 3-1

3.1 Enterprise Management Technologies. 3-2

3.1.1 Analysis of Enterprise Management Technologies. 3-2

3.1.2 Overlapping/ Harmonizing/ Missing Enterprise Management Technologies. 3-6

3.2 Data Management and Exchange Technologies. 3-7

3.2.1 Horizontal Data Management Technologies. 3-8

3.2.2 Field Device Technologies. 3-13

3.2.3 Control Center/Operations Technologies. 3-23

3.2.4 Energy Market Energy Market Technologies. 3-48

3.3 Platform Technologies. 3-51

3.3.1 Analysis of Platform Technologies. 3-51

3.4 Communications Infrastructure Technologies. 3-53

3.4.1 Analysis of Communications Infrastructure Technologies. 3-53

3.4.2 Communication Infrastructure Integration and Federation Strategy. 3-60

3.4.3 Overlapping, Harmonizing and Missing Communications Infrastructure Technologies. 3-64

3.5 Security Technology Overview.. 3-65

3.5.1 Interdependencies. 3-65

3.5.2 Service Specific Technological Recommendations. 3-67

3.5.3 Communication Technology Specific Recommendations. 3-68

3.5.4 Technologies that need to be created. 3-68

4. Deployment Scenarios. 4-1

4.1 Introduction. 4-1

4.2 Deployment Scenarios. 4-2

4.2.1 Field Device Integration Deployment Scenario. 4-2

4.2.2 Enterprise Management and Power Systems Integration Deployment Scenario. 4-8

4.2.3 Application Integration Deployment Scenario. 4-17

4.2.4 Asset Management Deployment Scenario. 4-22

4.2.5 Energy Market Integration Deployment Scenario. 4-27

5. Benefits. 5-1

5.1.1 Reusable Infrastructure. 5-1

5.1.2 Standards. 5-1

5.1.3 Off the shelf Adapters. 5-1

5.1.4 3rd Party Applications. 5-1

5.1.5 Extensible. 5-2

5.1.6 Incremental approach. 5-2

5.2 Conclusion. 5-2

APPENDIX A - SECURITY....................................................................... A-1

APPENDIX B – NETWORK MANAGEMENT TECHNOLOGIES......... B-1

APPENDIX C – RESILIENT COMMUNICATION SERVICES.............. C-1

APPENDIX D – TECHNOLOGIES, SERVICES, AND BEST PRACTICES

...................................................................................................................... D-1

Appendix E - Environments............................................................ E-1

List of Figures and Tables

Figure 1‑1: IECSA Reference Architecture Framework. 1-2

Figure 1‑2 Domain Use Cases From List of Business Functions 1-5

Figure 1‑3: Integrated Energy and Communication Systems Architecture (IECSA) RM-ODP Model 1-9

Figure 1‑4 Abstract Use Cases from Domain Use Cases 1-11

Figure 1‑5 Environments from Requirements 1-12

Figure 1‑6 The IECSA Abstract Use Cases 1-12

Figure 1‑7 IECSA Secure Enterprise Architecture. 1-21

Figure 1‑8 Enterprise Management and Power System Management Treated Independently. 1-22

Figure 1‑9 Integration of Enterprise and Power System Management 1-23

Figure 1‑10 Energy Market Transaction Service Communication. 1-27

Figure 1‑11 Integration Of Device Data. 1-30

Figure 1‑12 Applications To Be Integrated. 1-31

Figure 1‑13 Application Integration. 1-33

Figure 1‑14 Example Of Integrated Data. 1-34

Figure 1‑15 Field Service Integration Example. 1-35

Figure 1‑16: Representation of Security Domain Concept 1-36

Figure 1‑17 Point-to-Point Integration. 1-39

Figure 1‑18 Diagram of Components, Services, and Interfaces 1-41

Figure 1‑19 Adapters Use. 1-43

Figure 1‑20 Technology-Independent Architecture. 1-44

Figure 1‑21 IECSA Analysis Logic Flow. 1-46

Figure 1‑22 Utility Integration Layering. 1-48

Figure 2‑1 Example of eCommerce Message Flow. 2-10

Figure 2‑2 eCommerce Registry. 2-10

Figure 2‑3 Exposing Server Data. 2-14

Figure 2‑4 Device Information Exchange Model 2-15

Figure 2‑5 Application Integration Example. 2-16

Figure 2‑6 Message Queuing. 2-17

Figure 2‑7 Publish and Subscribe. 2-17

Figure 2‑8 Traditional Data Warehouse Architecture. 2-21

Figure 2‑9 Common Information Model Based Data Warehouse. 2-22

Figure 2‑10 Example Of A Data Warehouse Star Schema. 2-23

Figure 2‑11 Data Warehouse Connected to a Message Bus 2-25

Figure 2‑12 Data Mart Proliferation. 2-26

Figure 2‑13 Example Of A CIM/GID Based Data Warehouse. 2-27

Figure 2‑14 Example of CIM/GID Warehouse Connected to a Message Bus 2-28

Figure 2‑15 Example Information Model 2-43

Figure 2‑16 Use of a Common Exchange Model 2-44

Figure 2‑17 Applications Connect to Off the Shelf Middleware Via the Standard API’s 2-46

Figure 2‑18 Applying Technologies to Environments 2-47

Figure 2‑19 Ways That A Generic Interface Can Be Applied. 2-48

Figure 2‑20 Example Namespace. 2-50

Figure 2‑21 Example Generic Interface. 2-51

Figure 2‑22 Summary of IECSA Environments 2-53

Figure 2‑23 Technology Independent Architecture. 2-54

Figure 3‑1 RDF, RDFS, and OWL Build on Existing W3C Work. 3-9

Figure 3‑2 The Tree of Knowledge Technologies 3-10

Figure 3‑3 RDF Example. 3-11

Figure 3‑4 RDFS Example. 3-11

Figure 3‑5 OWL Example. 3-12

Figure 3‑6 The Evolution of DNP3 and IEC61850. 3-14

Figure 3‑7 Profile Comparison. 3-16

Figure 3‑8 Profile Comparison. 3-17

Figure 3‑9 Service Comparison. 3-18

Figure 3‑10 IEC61850 Object Model 3-20

Figure 3‑11 TC 57 Standards 3-23

Figure 3‑12 Simplified Fragment of CIM Power System Model 3-25

Figure 3‑13 Simplified Fragment of CIM Asset/Work Model 3-26

Figure 3‑14 Generalizations for power system resource and conducting equipment 3-27

Figure 3‑15 Defining connectivity for conducting equipment 3-28

Figure 3‑16 Transformer model illustrating use of aggregation. 3-29

Figure 3‑17: IEC61850 Models and Connections with IEC61970 Models 3-30

Figure 3‑18 Proposed Harmonization of 61850 and 61970 Information Models 3-33

Figure 3‑19 Example of a Full Mesh type of Namespace. 3-37

Figure 3‑20 Example TC57PhysicalNamespace. 3-38

Figure 3‑21 Example TC57ClassNamespace. 3-38

Figure 3‑22 Example TC57ISNamespace. 3-39

Figure 3‑23 Traditional view of utility data. 3-39

Figure 3‑24 Customer data within a CIM Network View. 3-40

Figure 3‑25 Example Full Mesh Namespace. 3-41

Figure 3‑26 Interface Lineage.