Blockchain for Big Data: AI, IoT and Cloud Perspectives

201 Pages·2021·5.564 MB·English

by  Shaoliang Peng

Blockchain for Big Data

Blockchain for Big Data
AI, IoT and Cloud Perspectives
Shaoliang Peng
First edition published 2022
by CRC Press
6000 Broken Sound Parkway NW, Suite 300, Boca Raton, FL 33487-2742
and by CRC Press
2 Park Square, Milton Park, Abingdon, Oxon, OX14 4RN
© 2022 Shaoliang Peng
CRC Press is an imprint of Taylor & Francis Group, LLC
Reasonable efforts have been made to publish reliable data and information, but the author and
publisher cannot assume responsibility for the validity of all materials or the consequences of
their use. The authors and publishers have attempted to trace the copyright holders of all m aterial
reproduced in this publication and apologize to copyright holders if permission to publish in this
form has not been obtained. If any copyright material has not been acknowledged please write
and let us know so we may rectify in any future reprint.
Except as permitted under U.S. Copyright Law, no part of this book may be reprinted,
reproduced, transmitted, or utilized in any form by any electronic, mechanical, or other means,
now known or hereafter invented, including photocopying, microfilming, and recording, or in
any information storage or retrieval system, without written permission from the publishers.
For permission to photocopy or use material electronically from this work, access www.copyright.
com or contact the Copyright Clearance Center, Inc. ( CCC), 222 Rosewood Drive, Danvers,
MA 01923, 9 78- 750-8400. For works that are not available on CCC please contact mpkbooks
[email protected]
Trademark notice: Product or corporate names may be trademarks or registered trademarks and
are used only for identification and explanation without intent to infringe.
Library of Congress Cataloging-in-Publication Data
Names: Peng, Shaoliang, 1979- author.
Title: Blockchain for big data : AI, IoT and cloud perspectives / Shaoliang Peng.
Description: First edition | Boca Raton : CRC Press, 2022. | Includes bibliographical references. |
Summary: “In this work, the author investigates the researches and applications of blockchain
technology in the field of Big Data and assesses the advantages and challenges that blockchain
technology may bring to big data. The author also analyses possible future directions of the
convergence of blockchain and big data”— Provided by publisher.
Identifiers: LCCN 2021010668 (print) | LCCN 2021010669 (ebook) |
ISBN 9781032063041 (hbk) | ISBN 9781032063133 (pbk) | ISBN 9781003201670 (ebk)
Subjects: LCSH: Blockchains (Databases)
Classification: LCC QA76.9.B56 P46 2022 (print) | LCC QA76.9.B56 (ebook) | DDC 005.74—dc23
LC record available at https://lccn.loc.gov/2021010668
LC ebook record available at https://lccn.loc.gov/2021010669
ISBN: 978- 1- 032- 06304-1 ( hbk)
ISBN: 978- 1- 032- 06313-3 ( pbk)
ISBN: 978- 1- 003- 20167-0 ( ebk)
Typeset in Minion
by codeMantra
Contents
Preface: Background and Overview, xiii
Author, xvii
Chapter 1 ◾ The Development of Big Data 1
1.1 THE CONCEPT OF BIG DATA 1
1.1.1 Large Amount of Data 2
1.1.2 Variety of Data Types 2
1.1.3 Fast Processing Speed 3
1.1.4 L ow-Value Density 3
1.2 THE PAST AND PRESENT OF BIG DATA 4
1.3 TECHNICAL SUPPORT OF BIG DATA 5
1.3.1 Storage Device Capacity Is Increasing 5
1.3.2 Increasing Network Bandwidth 6
1.3.3 CPU Processing Capacity Increased Significantly 7
1.3.4 The Deepening of Machine Learning 7
1.4 THE VALUE OF BIG DATA 8
1.4.1 Big Data Decision-Making Has Become a New
D ecision-Making Method 8
1.4.2 Big Data Application Promotes Deep Integration
of Information Technology and Various Industries 9
1.4.3 Big Data Development Promotes the Continuous
Emergence of New Technologies and Applications 9
1.4.4 Big Data as a Strategic Resource 10
v
vi ◾ Contents
1.5 KEY TECHNOLOGIES OF BIG DATA 11
1.5.1 Big Data Acquisition Technology 12
1.5.2 Big Data Preprocessing Technology 13
1.5.3 Big Data Storage and Management Technology 13
1.5.4 Big Data Analysis and Mining Technology 14
1.5.5 Big Data Presentation Technology 15
1.6 CHAPTER SUMMARY 16
REFERENCES 17
Chapter 2 ◾ B lockchain Technology 19
2.1 DIGITAL CURRENCY AND BITCOIN 19
2.1.1 Digital Currency 19
2.1.2 Bitcoin 21
2.2 BLOCKCHAIN 24
2.2.1 Blockchain Architecture 25
2.2.1.1 Data Layer 25
2.2.1.2 Network Layer 27
2.2.1.3 Consensus Layer 28
2.2.1.4 Smart Contract Layer 29
2.2.1.5 Application Layer 29
2.2.2 Characteristics of Blockchain 30
2.2.2.1 No Tampering 30
2.2.2.2 Uniqueness Required to Express Value 31
2.2.2.3 Smart Contract 32
2.2.2.4 Decentralised S elf-Organisation 32
2.2.3 Classification of Blockchain 34
2.2.3.1 Public Blockchain: Everyone can Participate 34
2.2.3.2 Consortium Blockchain: Only Consortium
Members can Participate 34
2.2.3.3 Private Blockchain: Only for Individuals or
Companies 35
Contents ◾ vii
2.3 CONSENSUS 35
2.3.1 Paxos and Raft 37
2.3.2 BFT and PBFT 38
2.3.3 Proof of Work 38
2.3.4 PoS 38
2.3.5 PoI 39
2.4 THE EVOLUTION OF BLOCKCHAIN TECHNOLOGY 40
2.4.1 The First Year of Blockchain History 40
2.4.2 Blockchain 1.0 42
2.4.3 Blockchain 2.0 44
2.4.4 Blockchain 3.0 44
2.5 CHAPTER SUMMARY 45
REFERENCES 47
Chapter 3 ◾ E volution of Two Technologies 49
3.1 DEVELOPMENT TREND OF BIG DATA TECHNOLOGY 49
3.2 KEY TECHNOLOGIES OF BIG DATA 51
3.2.1 Hadoop 52
3.2.2 MapReduce 53
3.2.3 Spark 56
3.3 DEVELOPMENT OF BLOCKCHAIN TECHNOLOGY 58
3.4 TAXONOMY OF BLOCKCHAIN SYSTEMS 64
3.5 SCALABILITY OF BLOCKCHAIN TECHNOLOGY 66
3.5.1 Sharding Mechanism 66
3.5.2 D AG-based 67
3.5.3 Off-Chain Payment Network 68
3.5.3.1 Lightning Network 68
3.5.3.2 Raiden Network 69
3.5.4 C ross-Chain Technology 70
3.5.4.1 M ulti-Centre Witness 71
3.5.4.2 Side Chain/ Relay Technology 71
viii ◾ Contents
3.5.4.3 Hash Locking 72
3.5.4.4 Distributed Private Key Control Technology 73
3.6 SIMILARITIES BETWEEN BIG DATA AND
BLOCKCHAIN TECHNOLOGY 74
3.7 DIFFERENCES BETWEEN BIG DATA AND
BLOCKCHAIN TECHNOLOGIES 75
3.8 CHAPTER SUMMARY 75
REFERENCES 76
Chapter 4 ◾ Convergence of Blockchain and Big Data 79
4.1 THE COMMERCIAL VALUE OF BLOCKCHAIN 79
4.1.1 TCP/ IP 81
4.1.2 Smart Assets for the Society 83
4.1.3 Docking Machine Economy 84
4.1.4 Optimise the Social Structure 85
4.2 WHAT CHANGES CAN BLOCKCHAIN BRING? 87
4.2.1 Security and Privacy 90
4.2.2 Credibility and Transparency 91
4.2.3 Data Sharing 91
4.2.4 Data Analysis 92
4.2.5 Protection of Data Sovereignty 93
4.2.6 Cost Reduction 94
4.3 BLOCKCHAIN TECHNOLOGY RECONSTRUCTS
BIG DATA INDUSTRY 94
4.3.1 Circulation Environment for Trusted Data Asset 95
4.3.2 Programmable Economy 97
4.3.3 Anonymity 98
4.3.4 Convenience of Payment 98
4.3.5 Irreversibility 99
4.4 CHALLENGES IN THE CONVERGENCE OF
BLOCKCHAIN AND BIG DATA 100
4.4.1 Scalability 101
Contents ◾ ix
4.4.2 Difficulty in Accurate Analysis 103
4.4.3 Data Storage 103
4.4.4 Consensus Upgrade 103
4.4.5 Intensified Competition 105
4.5 CHAPTER SUMMARY 105
REFERENCES 106
Chapter 5 ◾ Applications of Blockchain Technology 109
5.1 CHANGES IN THE FINANCIAL INDUSTRY 109
5.1.1 Supply Chain Finance 110
5.1.2 Digital Bill 111
5.1.3 Cross-Border Payment 112
5.2 INTERNET OF THINGS 112
5.2.1 Documentation and Traceability of Sensor Data 114
5.2.2 Smart M eter-Based Energy Trading 114
5.2.3 Safe Communication and Group Intelligence
for Drones 115
5.3 SMART HEALTHCARE 115
5.3.1 EHR 117
5.3.2 Drug A nti-Counterfeit Traceability 117
5.3.3 DNA Wallet 118
5.4 SUPPLY CHAIN 118
5.5 MANAGEMENT AND TRADING OF DIGITAL ASSETS 123
5.6 APPLICATION IN SMART CITY ROADSIDE PARKING 124
5.6.1 Edge-End Module 127
5.6.2 Fabric Module 128
5.6.3 Web Server Module 128
5.6.4 Client Module 128
5.7 APPLICATION IN TRACEABILITY OF CHINESE HERBS 128
5.8 VGUARD: A SPATIOTEMPORAL EFFICIENCY
DOUBLE-LEVEL BLOCKCHAIN METHOD FOR
VACCINE PRODUCTION SUPERVISION 135