As part of the testing, Coinbase Cryptostean employees independently analyzed 20 smart contracts of various tokens for risks, and then used ChatGPT for the same purpose.
IN 12 cases from 20 The conclusions of the neural network about the level of risks coincided with the conclusions experts.
“Of the eight cases of improper determination of ChatGPT risks in five cases, it assigned a low risk level of high -risk tokens. This is the worst version of the error - an underestimation of the risk of an asset can be much more dangerous, rather than overstating the level of risk ", - Say representatives of the company.
Analysts have noted the benefits of ChatGPT, However, they said, that it is too early to leave manual testing of smart contracts. According to Coinbase experts, The neural network does not work well, when she does not have enough contextual data to analyze. Besides, ChatGPT pays too much attention to comments in the smart contract code, Whereas the logic of the program itself is more important.
“Although ChatGPT shows the potential to quickly assess the risk of smart contracts, The conclusions of the neural network are too unreliable, To integrate it into the process assessment assessment processes on Coinbase. We expect, that with proper engineering the accuracy of the tool can be increased, However, it is impossible to completely rely on it ", - Representatives of the exchange draw conclusion.
The popularity of the neural network ChatGPT has attracted the attention of scammers. Recently developers of the Harvest Keeper project, who "used AI and neural networks to optimize trade" disappeared
with user assets in the amount from above $1 million.
