Iâm not a blockchain expert myself, but after speaking with Rhian Lewis about blockchain Application Testing, Iâd like to share some info that Iâve found helpful.
Before we look at some testing tools, letâs make sure that we are all on the same page with what blockchain is.
What is Blockchain?Â
Most folks know blockchain as the protocol that underpins Bitcoin, but itâs much more than that. You can essentially think of it as an âappends onlyâ digital ledgerâsimilar to a shared spreadsheet record.
Itâs basically a data structure which exists in many different places at once and which is very difficult to make amendments to because you can’t ever delete from it. You can only add to it.
This is a cool feature because it exchanges its central power structure model for a decentralized network of independent record keepers.
This approach minimizes the possibility of an unauthorized person being able to manipulate records. In turn, this makes the record more secure, giving users more confidence in the digital data that is in the blockchain.
How Do You Test Blockchain Applications?
Rhian and I agree that itâs really not much different from any other application you would test. The same logic and critical thinking you already use for testing non-blockchain projects still apply.
Of course, the individuals working on blockchain applications need to possess amazing mathematical and cryptographic skills, but when it comes down to it most of the work that’s being done is just normal development work with normal testing criteria.
Many of the testing techniques you already know, like testing at the boundary, performance testing, compliance and especially security testing, apply to blockchain. Sometimes its just a matter of getting familiar with some of the common blockchain testing tools that are already out there.
Blockchain Testing Tools
During my interview with her, Rhian mentioned that in terms of hands-on testing, there are some pretty good tools and frameworks being developed that can help with both development and testing.
I went looking for some of these blockchain testing tools, and this is what I found:
Ethereum
Ethereum is the best-known blockchain (other than Bitcoin), and it has some great frameworks for developing applications, many of which have libraries baked in to make testing fairly easy.
Ethereum Tester
Simply put, Ethereum Tester provides tools for testing Ethereum-based applications.
Truffle
Truffle bills itself as the most popular Ethereum development framework, and based on its 4,288 stars on GitHub it, clearly is popular.
Itâs a development framework that has testing functionality, like the ability to write automated tests for your contracts in both JavaScript and Solidity and get your contracts developed quickly. It also works with popular test runners like Mocha and Chai.
Ganache (formally Testrpc)
Before you release your blockchain application to production, itâs important that you test it locally.
Ganache is the most-used library for testing Ethereum contracts locally. It works by spinning up a kind of mock blockchain that gives you access to accounts you can use for testing.
Rhian doesnât feel that it conveys the same latency you get on a live system, doesn’t really replicate real-world scenarios for the time things take and so on. But it’s enough to let you compile a contract, deploy it, determine its cost, and debug it locally.
Populus
For testers who prefer Python, the Populus framework provides some powerful utilities for testing blockchain contracts. Testing in Populus is powered by the Python testing framework py.test.
Manticore
Manticore is a symbolic execution tool for analysis of binaries and smart contracts. Manticore enables human-assisted analysis and the automatic detection of vulnerabilities.
Hyperledger Composer
Hyperledger Composer is an open-source development tool that contains many functions to help build blockchain applications. Some of those features also help with testing. More specifically, it supports three types of testing: interactive testing, automated unit testing and automated system testing.
It has a command-line interface that provides commands allowing you to easily run interactive “smoke tests” to ensure the deployment was successful. This also makes it easy to execute tests in a CI/D system.
System tests can also be created using Docker Compose and Mocha/Chai. You can start a runtime and deploy your business network definition, then programmatically create assets, submit transactions and inspect the state of asset registries.
Exonum Testkit
Testkit for Exonum Blockchain is a framework that allows you to test the operation of the whole service. Specifically, it allows you to test transaction execution and APIs in the synchronous environment (without consensus algorithm) and in the same system process.
Embark Framework
Embark is another popular framework for building, testing and deploying your app. Itâs a framework that allows you to easily develop and deploy decentralized applications (DApps).
Corda Testing Tools
Corda is a blockchain-inspired, open-source distributed ledger platform. It has a built-in testing feature to help with:
BitcoinJ
BitcoinJ is a library for working with the Bitcoin protocol. It allows you to interact with Bitcoin and connect directly to the Bitcoin network. And by using the functions in this library, we can send and receive Bitcoins in real time.
The BitcoinJ documentation says it can maintain a wallet, send/receive transactions without needing a local copy of Bitcoin Core, along with many other advanced features. It’s implemented in Java but can be used from any JVM-compatible language; examples in Python and JavaScript are included.
For testing, BitcoinJ provides a TestUtils class that can do things like manufacture fake transaction objects and so on.
For ideas on how to take advantage of TestUtils, take a look at the test suite for BitcoinJ itself.
Testers get Started with Blockchain
Many of these testing activities are currently being done by developers doing their own testing. This is awesome, but as blockchain gains popularity, testers will need to start getting involved as well.
It’s simply a matter of making a small leap of faith into a technology that is completely different than what you may have tested in the past.
Iâm hoping this article will give you enough information to start your own blockchain testing investigation, and set you on your way to being comfortable with this technology.
Rhian Lewis an awesome resource, so be sure to follow her on Twitter.
Rumor also has it that she may be developing an online tester course on EthereumâŚso stay tuned!
Joe Colantonio is the founder of TestGuild, an industry-leading platform for automation testing and software testing tools. With over 25 years of hands-on experience, he has worked with top enterprise companies, helped develop early test automation tools and frameworks, and runs the largest online automation testing conference, Automation Guild.
Joe is also the author of Automation Awesomeness: 260 Actionable Affirmations To Improve Your QA & Automation Testing Skills and the host of the TestGuild podcast, which he has released weekly since 2014, making it the longest-running podcast dedicated to automation testing. Over the years, he has interviewed top thought leaders in DevOps, AI-driven test automation, and software quality, shaping the conversation in the industry.
With a reach of over 400,000 across his YouTube channel, LinkedIn, email list, and other social channels, Joeâs insights impact thousands of testers and engineers worldwide.
He has worked with some of the top companies in software testing and automation, including Tricentis, Keysight, Applitools, and BrowserStack, as sponsors and partners, helping them connect with the right audience in the automation testing space.
Follow him on LinkedIn or check out more at TestGuild.com.
Related Posts
Mobile testing is the systematic process of evaluating mobile applications to ensure they function correctly, provide excellent user experience, and […]
Love it or hate itâBehavior Driven Development is still widely used. And unfortunately still miss-understood. Youâve probably heard a lot […]
ETL stands for Extraction, Transformation, and Load (ETL). How do you test it? This guide covers what you need to know to get started.
I originally wrote this post in 2012 but I still get email asking if it is still possible to use […]