Skip to main content
  • Research article
  • Open access
  • Published:

Development of a convolutional neural network for the identification and the measurement of the median nerve on ultrasound images acquired at carpal tunnel level

Abstract

Background

Deep learning applied to ultrasound (US) can provide a feedback to the sonographer about the correct identification of scanned tissues and allows for faster and standardized measurements. The most frequently adopted parameter for US diagnosis of carpal tunnel syndrome is the increasing of the cross-sectional area (CSA) of the median nerve. Our aim was to develop a deep learning algorithm, relying on convolutional neural networks (CNNs), for the localization and segmentation of the median nerve and the automatic measurement of its CSA on US images acquired at the proximal inlet of the carpal tunnel.

Methods

Consecutive patients with rheumatic and musculoskeletal disorders were recruited. Transverse US images were acquired at the carpal tunnel inlet, and the CSA was manually measured. Anatomical variants were registered. The dataset consisted of 246 images (157 for training, 40 for validation, and 49 for testing) from 103 patients each associated with manual annotations of the nerve boundary. A Mask R-CNN, state-of-the-art CNN for image semantic segmentation, was trained on this dataset to accurately localize and segment the median nerve section. To evaluate the performances on the testing set, precision (Prec), recall (Rec), mean average precision (mAP), and Dice similarity coefficient (DSC) were computed. A sub-analysis excluding anatomical variants was performed. The CSA was automatically measured by the algorithm.

Results

The algorithm correctly identified the median nerve in 41/49 images (83.7%) and in 41/43 images (95.3%) excluding anatomical variants. The following metrics were obtained (with and without anatomical variants, respectively): Prec 0.86 ± 0.33 and 0.96 ± 0.18, Rec 0.88 ± 0.33 and 0.98 ± 0.15, mAP 0.88 ± 0.33 and 0.98 ± 0.15, and DSC 0.86 ± 0.19 and 0.88 ± 0.19. The agreement between the algorithm and the sonographer CSA measurements was excellent [ICC 0.97 (0.94–0.98)].

Conclusions

The developed algorithm has shown excellent performances, especially if excluding anatomical variants. Future research should aim at expanding the US image dataset including a wider spectrum of normal anatomy and pathology. This deep learning approach has shown very high potentiality for a fully automatic support for US assessment of carpal tunnel syndrome.

Background

Carpal tunnel syndrome (CTS) is commonly encountered in rheumatology daily practice, and it is a frequent condition also in other healthcare settings such as orthopedics, neurology, physiatry, and primary care [1]. It is defined as the constellation of signs and symptoms due to the compression of the median nerve while it passes through the carpal tunnel [2]. Even if the diagnosis relies on clinical history and physical examination, confirmatory tests such as nerve conduction studies and ultrasound (US) are often used [2].

In particular, US is helpful in assisting the diagnosis of CTS [3,4,5], and it adds value to electrodiagnosis, being capable of identifying pathological median nerve swelling as well as the cause of the compression of the median nerve (e.g., flexor tendons tenosynovitis, wrist synovitis, tophi, or persistent median artery thrombosis) [6,7,8,9].

The most frequently adopted parameter for US diagnosis of CTS is the increasing of the cross-sectional area (CSA) of the median nerve measured at the proximal inlet of the carpal tunnel (at the level of the pisiform bone) [10, 11].

Some of the limitations to the spread of US in rheumatology are its operator dependency, the need for a supervised training, and the inter-observer variability in obtaining standardized measurements [12].

Recently, artificial intelligence (AI), and in particular deep learning (DL), applied to US has demonstrated to be a possible solution to some of these issues. In fact, it can provide an immediate feedback to the beginner sonographer about the correct identification of scanned tissues and allows for faster and more standardized measurements [13,14,15,16,17].

In spite of such promising results, only a relatively small number of studies have applied DL to US in the field of rheumatic and musculoskeletal diseases [18,19,20,21,22], and the contributions focusing on its application on the US assessment of CTS are even fewer [23, 24].

DL is a class of AI algorithms that is inspired by the structure of the human brain, capable of autonomous learning and composed by many layers of artificial neurons that extract higher-level features from data [25]. Convolutional neural networks (CNNs) are DL algorithms designed for processing structured arrays of data such as images, suited to solve various image analysis tasks, such as object classification, detection, and segmentation, in a variety of different fields, including medical image analysis [25, 26].

The main aim of the present study was to develop an end-to-end CNN, i.e., Mask R-CNN [27], for the localization and segmentation of the median nerve and the automatic measurement of its CSA on US images acquired at the inlet of the carpal tunnel.

Materials and methods

US image acquisition, interpretation, and annotation

Consecutive patients with rheumatic and musculoskeletal disorders were recruited at the Rheumatology Unit of “Carlo Urbani” Hospital in Jesi, Italy. Patients < 18 years old were excluded. The study was conducted in accordance with the Helsinki Declaration and was approved by the local ethics committee (Comitato Etico Regione Marche, number 262). All patients signed informed consent.

Basic clinical and demographic data were collected. The US assessment was performed by one of three sonographers with different degrees of experience in musculoskeletal US (G.Sa.: 1 month with a dedicated intensive training; G.Sm.: 4 years; E.Fi.: more than 20 years of experience) with a MyLab Class C (Esaote Spa, Genoa, Italy) US system equipped with a linear 6–18-MHz probe.

Patients were seated in a comfortable position, with the forearm resting supine on the examination bed and fingers in neutral position. Each wrist was scanned in transverse views according with the 2017 EULAR standardized procedures for US imaging in rheumatology [28]. Representative images were acquired bilaterally at the carpal tunnel proximal inlet (at the level of the pisiform bone). The sonographer measured the CSA by tracing a continuous line within the hyperechogenic boundary of the nerve (along the internal margin of the epineurium). The presence of the following anatomical variants was registered: bifid median nerve, persistent median artery, and accessory muscles within the carpal tunnel. In the case of the bifid median nerve, the CSA was measured summing the areas of both branches.

All the images were reviewed by the expert sonographer (E.Fi.), and images not considered informative due to insufficient quality were excluded. The boundary of the nerve was manually annotated in each image of the dataset by the same operator (G.Sa.)

CNN algorithm training and training strategy

In this work, Mask R-CNN [27] was trained for median nerve semantic segmentation from US images. Mask R-CNN integrates object detection task, where the goal is to detect object class along with bounding box prediction in an image, and consequently semantic segmentation task, which classifies each pixel into pre-defined categories. Thus, it enables to segment precisely median nerve boundaries, once learned its location in the US image.

This DL algorithm mainly works in two stages: first, it generates proposals about the regions where the target object might be based on the input image; second, it predicts the object class and its location refining the bounding box and from that its contours generating a mask in pixel level of the object based on the first stage proposal. A schematic representation of this end-to-end deep learning algorithm is shown in Fig. 1.

Fig. 1
figure 1

Mask R-CNN is a CNN made of backbone (composed by a ResNet101 and a feature pyramid network (FPN)), a region proposal network (RPN), ROIAlign, and three heads, for classification, bounding-box regression, and segmentation

More specifically, we implemented a ResNet101 [29] combined with the feature pyramid network (FPN) [30], as backbone, to extract features from the input image at multiple levels. Subsequently, the region proposal network (RPN) generates proposals, then selected and processed by the ROIAlign layer that resizes them to a constant output dimension before passing them to the Mask R-CNN heads [27]. From the original Mask R-CNN implementation, we increased the output resolution of the segmentation head using three transposed convolutions with 256 2 × 2 filters and activated with the rectified linear unit (ReLU), instead of only one, to cope with the fragmented and low-contrasted edges of the median nerve.

The dataset consisted of 246 images from 103 patients, associated with manual annotations, which were used as ground truth to teach the algorithm to correctly localize and segment the median nerve. For this purpose, the dataset was split over patients in three parts: 157 images from 64 subjects for training, 40 images from 16 subjects for validation, and 49 images from 23 subjects for testing.

From the original size of 606 × 468 pixels, each US image and the corresponding annotation mask were resized to 512 × 512 pixels and zero-padded at right-most and bottom-most edges to get squared images with a size multiple of 32, as required by the FPN, while preserving the original aspect ratio.

To make up for the relatively small size of our dataset, weights computed on the COCO dataset [31] were used to initialize all layers of the model except for the input layers of the network heads and during training on-the-fly data augmentation was performed by randomly scaling in the range of (0.8, 1.2) and random translating in the range (− 0.2, 0.2) in both directions and performing random rotation between − 10 and 10 and shearing between − 2 and 2.

The training was performed using the Stochastic Gradient Descent as an optimizer for 150 epochs with an initial learning rate of 0.001 and momentum of 0.9.

A total of 256 anchors per image was used, with varying sizes (32, 64, 128, 256, and 512) and aspect ratios (1:1, 2:1, 1:2). These values were chosen considering the median nerve section dimension. The ROIAlign resized proposals to a fixed size of 14 × 14. Hence, the output of the proposed segmentation had a resolution of 112 × 112.

The model was trained using a multi-task cross-entropy loss function combining the loss of classification, localization, and segmentation mask: L = Lcls + Lbbox + Lmask, where LclsLbbox, and Lmask are respectively class, bounding box, and mask losses [27].

Performance metrics

We considered a true positive (TP) prediction if the predicted bounding box overlapped the ground truth for at least 70% and had confidence higher than 0.98. Otherwise, the nerve detection was considered as false positive (FP). We considered a false negative (FN) when no bounding box was predicted at all.

To evaluate the performance in median nerve localization, precision (Prec) and recall (Rec) were computed as follows:

$${\displaystyle \begin{array}{l}\mathrm{Prec}=\frac{\mathrm{TP}}{\mathrm{TP}+\mathrm{FP}}\\ {}\mathrm{Rec}=\frac{\mathrm{TP}}{\mathrm{TP}+\mathrm{FP}}\end{array}}$$

The mean average precision (mAP), which represents the average of the area under the recall-precision curve, was also computed.

The median nerve segmentation performance was measured using the Dice similarity coefficient (DSC), which is defined as follows:

$$\mathrm{DSC}=\frac{2\times \left|{A}_{\mathrm{gt}}\cap {A}_{\mathrm{mask}}\right|}{\left|{A}_{\mathrm{gt}}\ \right|+\left|{A}_{\mathrm{mask}}\right|}$$

where Agt and Amask are the ground truth and predicted segmentation, respectively. When computing the DSC, only TPs were considered.

Prec, Rec, mAP, and DSC values can range between a minimum of 0 and a maximum of 1.

We also calculated the percentage of the images of the testing set in which the algorithm correctly identified only the true median nerve (TP prediction in the absence of a concomitant FN prediction in the same image).

CSA automatic measurement

The CSA was automatically calculated from the median nerve section predicted by the algorithm, knowing the dimensions of a single pixel (0.062 mm × 0.062 mm) composing the US images. The CSA was calculated only on TP predictions, excluding images with FP predictions.

Statistical analysis

The results are expressed as number and/or corresponding percentage for qualitative variables and as mean and standard deviation (SD) for quantitative variables. The chi-square test and the Mann-Whitney test were used to compare the qualitative and quantitative variables, respectively. The agreement in the CSA measurements between the operator (i.e., the gold standard) and the algorithm was calculated using a two-way mixed-effects intraclass correlation coefficient (ICC) with 95% confidence interval (CI).

The ICC is regarded as excellent if above 0.9, as good if between 0.75 and 0.9, as fair if between 0.4 and 0.75, and as poor if below 0.4.

Results

Patient characteristics

A total of 103 rheumatic patients were consecutively included in this single-center and cross-sectional study. Table 1 shows the main demographic characteristics of the participants.

Table 1 Demographic and clinical characteristics of 103 patients with rheumatic and musculoskeletal disorders included

Twenty-two out of 103 patients (21%) had a clinical diagnosis of CTS (10 unilateral, 13 bilateral).

Performance metrics in the identification of the median nerve

The algorithm made 43 correct predictions (TP), two FN predictions, and six FP predictions.

Table 2 shows the results of the performance metrics for the localization (Prec, Rec, and mAP) and the segmentation (DSC) of the median nerve.

Table 2 Performance metrics of the convolutional neural network (CNN) algorithm for the localization and segmentation of the median nerve

Overall, the algorithm correctly identified and segmented the median nerve in 41 out of 49 images (83.7%) (Fig. 2).

Fig. 2
figure 2

Correct localization and segmentation of the median nerve. Transverse scans acquired at the carpal tunnel proximal inlet in two patients (A-A′ and B-B′) showing in the left panels (A and B) the manual annotations of the boundary of the median nerve made by the operator (arrows) and in the right panels (A′ and B′) the corresponding predictions made by the algorithm (open arrows). p, pisiform bone

After a revision by the expert sonographers of the cause of the errors made by the algorithm, it was noted that the algorithm underperformed when it was asked to interpret images with anatomical variants (i.e., bifid median nerve or prominent persistent median artery). A sample of US images of the testing set containing anatomical variants is represented in Fig. 3.

Fig. 3
figure 3

Representative images of incorrect predictions. Transverse scans acquired at the carpal tunnel proximal inlet in two patients showing the correct identification of only one branch (open arrow) of a bifid median nerve (arrows) (A-A′) and the wrong inclusion of an adjacent vessel (arrowhead) in the prediction of the median nerve (asterisk) (B-B′). p, pisiform bone

Thus, we performed a sub-analysis of the performance metrics excluding such relatively rare anatomical variants from the testing set (n = 6). These results are shown in Table 3. In such sub-analysis, the algorithm correctly identified and segmented the median nerve in 41 out of 43 images (95.3%). In both images with incorrect predictions, the algorithm considered a nearby tendinous structure as another branch of the median nerve (i.e., the flexor carpi radialis tendon in one image and one of the finger flexor tendons in the other). These incorrect predictions may be related to the fact that in the transverse US view, the tendons show an oval shape, which is very similar to the one of the median nerve.

Table 3 Performance metrics of the convolutional neural network (CNN) algorithm for the localization and segmentation of the median nerve in images without anatomical variants (i.e., bifid median nerve or prominent persistent median artery)

We trained and tested the algorithm using TensorFlow on a GPU GeForce RTX 2080, and the average inference time was 1.7 s, which could be further reduced with computational resources higher than the ones available for our study.

CSA automatic measurement

The average CSA measured by the operator was 10.4 ± 4.6 mm2 while the average CSA automatically calculated by the algorithm was 10.4 ± 4.3 mm2, with no significant difference (p = 0.88).

The agreement between the automatic algorithm measurement and the sonographer manual measurement of the CSA was excellent [ICC 0.97 (95% CI 0.94–0.98)].

Discussion

In the last decades, US has largely demonstrated its usefulness in several aspects of the management of patients with rheumatic diseases [32,33,34]. It is safe, cost-effective, readily accessible, and generally well tolerated by the patients. Despite all the above, US is still far from being systematically adopted in rheumatology daily practice. This is largely due to its operator dependency and the intrinsic difficulties in standardizing measurements which may undermine its reproducibility.

DL has the potential to fill these gaps, facilitating a self-teaching approach not requiring continuous supervision by an expert sonographer and increasing standardization and reproducibility.

DL application to US is of particular interest in the setting of CTS assessment. In fact, CTS is a frequent condition encompassing many different medical specialties such as rheumatology, orthopedics, neurology, physiatry, and primary care. There is a growing body of evidence highlighting the value of US detection of the thickening of the median nerve (measured with the CSA obtained at the proximal inlet of carpal tunnel) as a confirmatory diagnostic test on top of clinical examination. Moreover, in patients with CTS, differently from electrophysiology, US can demonstrate the cause of the compression of the median nerve (e.g., tenosynovitis) [7].

However, despite this, US is struggling to find its place in the diagnostic work-up, being rarely preferred to or carried out together with electrodiagnostic tests. This may be partially due to the lack of the competencies needed to perform and interpret an US examination at the carpal tunnel level among different specialists facing CTS.

The correct identification of the median nerve is the first step for any beginner sonographer that approaches CTS assessment. The distinction of the median nerve from the finger flexor tendons is not an easy task due to the similar round shape on the transverse view. Sonographic criteria for the identification of peripheral nerve morphology were proposed by Silvestri et al. [35]. The authors stated that on transverse scans, peripheral nerves, including the median nerve, are characterized by the presence of multiple rounded hypoechoic areas with a homogeneous hyperechoic background (i.e., fascicular pattern). The fascicular pattern characteristic of nerves may be differentiated from tendons’ fibrillar pattern (linear hypo- and hyperechoic areas on transverse scan).

Such pattern recognition is a well-suited task for DL. Thus, we proposed an end-to-end DL approach to median nerve segmentation from US images acquired into daily clinical practice.

Our results show that the developed CNN algorithm is accurate in the identification and segmentation of median nerve on transverse US images acquired at the proximal inlet of the carpal tunnel.

If implemented on US machines, it would offer an almost real-time automatic feedback to the beginner sonographer approaching CTS US, avoiding the need of continuous supervision by an expert sonographer.

Furthermore, the present CNN algorithm is not only useful for the unexperienced sonographer. We demonstrated that the agreement between the automated measurement and the manual measurement of the CSA was excellent. Such result has relevant implications, allowing for a fast, accurate, and reproducible automated measurement of CSA that would be an upgrade even for expert sonographers if implemented on the US machine. In fact, the manual measurement of the CSA is time-consuming and can increase both the intra- and inter-reader variability.

The developed algorithm, even though almost perfect in normal anatomy images analysis, has demonstrated a sub-optimal performance when asked to interpret US images with relatively infrequent anatomical variants. In particular, a bifid median nerve has been previously found in 15–18% of patients by US [36]. This represents a relevant aspect to keep in mind when interpreting the results of the present study. In fact, the impact of different anatomical variants on the performances of the algorithm may be the main obstacle to the immediate application of this software in clinical practice. Thus, future research should focus on the expansion of the dataset with US images encompassing a wider spectrum of normal anatomy at the carpal tunnel level in order to improve the algorithm performances and its generalization.

Our study has some limitations. First, the dataset is relatively small, thus not encompassing the entire spectrum of the possible anatomical variants and pathologic changes at the carpal tunnel level. Second, the US images were obtained with a high-end equipment; therefore, our results may not be generalizable if low-quality US machines/low-frequency probes are used. Moreover, the algorithm was developed and tested with US images considered of sufficient quality; thus, such a quality level represents a pre-requisite for this algorithm application. Finally, the single-center design of the study may further limit the generalizability of our results.

Conclusions

In the present study, we developed a CNN algorithm for the localization and segmentation of the median nerve and for the automatic measurement of its CSA on US images acquired at the proximal inlet of the carpal tunnel. Such algorithm has shown excellent performances, even though future research should aim at expanding the US images dataset in order to further improve its performance in the presence of anatomical variants. This DL approach has shown very high potentiality for a fully automatic US support for CTS evaluation.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

AI:

Artificial intelligence

DL:

Deep learning

CI:

Confidence interval

CNN:

Convolutional neural network

CSA:

Cross-sectional area

CTS:

Carpal tunnel syndrome

DSC:

Dice similarity coefficient

FN:

False negative

FP:

False positive

FPN:

Feature pyramid network

ICC:

Intraclass correlation coefficient

mAP:

Mean average precision

Prec:

Precision

Rec:

Recall

ReLU:

Rectified linear unit

RPN:

Region proposal network

SD:

Standard deviation

TP:

True positive

US:

Ultrasound

References

  1. Doughty CT, Bowley MP. Entrapment neuropathies of the upper extremity. Med Clin North Am. 2019;103:357–70. https://0-doi-org.brum.beds.ac.uk/10.1016/j.mcna.2018.10.012.

    Article  PubMed  Google Scholar 

  2. Padua L, Coraci D, Erra C, Pazzaglia C, Paolasso I, Loreti C, et al. Carpal tunnel syndrome: clinical features, diagnosis, and management. Lancet Neurol. 2016;15:1273–84. https://0-doi-org.brum.beds.ac.uk/10.1016/S1474-4422(16)30231-9.

    Article  Google Scholar 

  3. Fowler JR, Gaughan JP, Ilyas AM. The sensitivity and specificity of ultrasound for the diagnosis of carpal tunnel syndrome: a meta-analysis. Clin Orthop Relat Res. 2011;469:1089–94. https://0-doi-org.brum.beds.ac.uk/10.1007/s11999-010-1637-5.

    Article  PubMed  Google Scholar 

  4. Tai TW, Wu CY, Su FC, Chern TC, Jou IM. Ultrasonography for diagnosing carpal tunnel syndrome: a Meta-analysis of diagnostic test accuracy. Ultrasound Med Biol. 2012;38(7):1121–8. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ultrasmedbio.2012.02.026.

    Article  PubMed  Google Scholar 

  5. Descatha A, Huard L, Aubert F, Barbato B, Gorand O, Chastang JF. Meta-analysis on the performance of sonography for the diagnosis of carpal tunnel syndrome. Semin Arthritis Rheum. 2012;41:914–22. https://0-doi-org.brum.beds.ac.uk/10.1016/j.semarthrit.2011.11.006.

    Article  PubMed  Google Scholar 

  6. French C, Cartwright MS, Hobson-Webb LD, Boon AJ, Alter KE, Hunt CH, et al. Evidence-based guideline: neuromuscular ultrasound for the diagnosis of carpal tunnel syndrome. Muscle Nerve. 2012;46(2):287–93. https://0-doi-org.brum.beds.ac.uk/10.1002/mus.23389.

    Article  Google Scholar 

  7. Smerilli G, Di Matteo A, Cipolletta E, Carloni S, Incorvaia A, Di Carlo M, et al. Ultrasound assessment of carpal tunnel in rheumatoid arthritis and idiopathic carpal tunnel syndrome. Clin Rheumatol. 2021;40:1085–92. https://0-doi-org.brum.beds.ac.uk/10.1007/s10067-020-05293-z.

    Article  PubMed  Google Scholar 

  8. Smerilli G, Di Battista J, Cipolletta E, Grassi W, Filippucci E. Additional value of ultrasound in the assessment of carpal tunnel syndrome in rheumatological daily practice. A case of persistent median artery thrombosis. Joint Bone Spine. 2020;87(6):666–7. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jbspin.2020.04.018.

    Article  PubMed  Google Scholar 

  9. Grassi W, Filippucci E, Carotti M, Salaffi F. Imaging modalities for identifying the origin of regional musculoskeletal pain. Best Pract Res Clin Rheumatol. 2003;17:17–32. https://0-doi-org.brum.beds.ac.uk/10.1016/s1521-6942(02)00099-2.

    Article  PubMed  Google Scholar 

  10. Roll SC, Case-Smith J, Evans KD. Diagnostic accuracy of ultrasonography VS. electromyography in carpal tunnel syndrome: a systematic review of literature. Ultrasound Med Biol. 2011;37:1539–53. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ultrasmedbio.2011.06.011.

    Article  PubMed  Google Scholar 

  11. Filippucci E, Iagnocco A, Meenagh G, Riente L, Delle Sedie A, Bombardieri S, et al. Ultrasound imaging for the rheumatologist II. Ultrasonography of the hand and wrist. Clin Exp Rheumatol. 2006;24:118–22.

    CAS  PubMed  Google Scholar 

  12. Delle Sedie A, Riente L, Bombardieri S. Limits and perspectives of ultrasound in the diagnosis and management of rheumatic diseases. Mod Rheumatol. 2008;18:125–31. https://0-doi-org.brum.beds.ac.uk/10.1007/s10165-008-0046-z.

    Article  PubMed  Google Scholar 

  13. Stoel B. Use of artificial intelligence in imaging in rheumatology-current status and future perspectives. RMD Open. 2020;6:e001063. https://0-doi-org.brum.beds.ac.uk/10.1136/rmdopen-2019-001063.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Akkus Z, Cai J, Boonrod A, Zeinoddini A, Weston AD, Philbrick KA, et al. A survey of deep-learning applications in ultrasound: artificial intelligence–powered ultrasound for improving clinical workflow. J Am Coll Radiol. 2019;16:1318–28. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jacr.2019.06.004.

    Article  PubMed  Google Scholar 

  15. Cipolletta E, Fiorentino MC, Moccia S, Guidotti I, Grassi W, Filippucci E, et al. Artificial Intelligence for Ultrasound Informative Image Selection of Metacarpal Head Cartilage. A Pilot Study. Front Med (Lausanne). 2021;8:589197. https://0-doi-org.brum.beds.ac.uk/10.3389/fmed.2021.589197.

    Article  Google Scholar 

  16. Moccia S, De Momi E, El Hadji S, Mattos LS. Blood vessel segmentation algorithms — review of methods, datasets and evaluation metrics. Comput Methods Prog Biomed. 2018;158:71–91. https://0-doi-org.brum.beds.ac.uk/10.1016/j.cmpb.2018.02.001.

    Article  Google Scholar 

  17. Zaffino P, Moccia S, De Momi E, Spadea MF. A review on advances in intra-operative imaging for surgery and therapy: imagining the operating room of the future. Ann Biomed Eng. 2020;48:2171–91. https://0-doi-org.brum.beds.ac.uk/10.1007/s10439-020-02553-6.

    Article  PubMed  Google Scholar 

  18. Chang RF, Lee CC, Lo CM. Computer-aided diagnosis of different rotator cuff lesions using shoulder musculoskeletal ultrasound. Ultrasound Med Biol. 2016;42:2315–22. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ultrasmedbio.2016.05.016.

    Article  PubMed  Google Scholar 

  19. Klauser AS, Franz M, Bellmann Weiler R, Gruber J, Hartig F, Mur E, et al. Contrast-enhanced ultrasonography for the detection of joint vascularity in arthritis - subjective grading versus computer-aided objective quantification. Ultraschall Med. 2011;32(Suppl 2):E31–7. https://0-doi-org.brum.beds.ac.uk/10.1055/s-0031-1281671.

    Article  PubMed  Google Scholar 

  20. Andersen JKH, Pedersen JS, Laursen MS, Holtz K, Grauslund J, Savarimuthu TR, et al. Neural networks for automatic scoring of arthritis disease activity on ultrasound images. RMD Open. 2019;5:e000891. https://0-doi-org.brum.beds.ac.uk/10.1136/rmdopen-2018-000891.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Christensen ABH, Just SA, Andersen JKH, Savarimuthu TR. Applying cascaded convolutional neural network design further enhances automatic scoring of arthritis disease activity on ultrasound images from rheumatoid arthritis patients. Ann Rheum Dis. 2020;79:1189–93. https://0-doi-org.brum.beds.ac.uk/10.1136/annrheumdis-2019-216636 Epub 2020 Jun 5.

    Article  PubMed  Google Scholar 

  22. Roncato C, Perez L, Brochet-Guégan A, Allix-Béguec C, Raimbeau A, Gautier G, et al. Colour Doppler ultrasound of temporal arteries for the diagnosis of giant cell arteritis: a multicentre deep learning study. Clin Exp Rheumatol. 2020;38(Suppl 124):120–5.

    PubMed  Google Scholar 

  23. Horng MH, Yang CW, Sun YN, Yang TH. DeepNerve: a new convolutional neural network for the localization and segmentation of the median nerve in ultrasound image sequences. Ultrasound Med Biol. 2020;46:2439–52. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ultrasmedbio.2020.03.017.

    Article  PubMed  Google Scholar 

  24. Wang YW, Chang RF, Horng YS, Chen CJ. MNT-DeepSL: median nerve tracking from carpal tunnel ultrasound images with deep similarity learning and analysis on continuous wrist motions. Comput Med Imaging Graph. 2020;80:101687. https://0-doi-org.brum.beds.ac.uk/10.1016/j.compmedimag.2019.101687.

    Article  PubMed  Google Scholar 

  25. Liu S, Wang Y, Yang X, Lei B, Liu L, Li SX, et al. Deep learning in medical ultrasound analysis: a review. Engineering. 2019;5:261–75. https://0-doi-org.brum.beds.ac.uk/10.1016/j.eng.2018.11.020.

    Article  Google Scholar 

  26. Bressem KK, Vahldiek JL, Adams L, Niehues SM, Haibel H, Rios Rodriguez V, et al. Deep learning for detection of radiographic sacroiliitis: achieving expert-level performance. Arthritis Res Ther. 2021;23:106. https://0-doi-org.brum.beds.ac.uk/10.1186/s13075-021-02484-0.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. He K, Gkioxari G, Dollár P, Girshick RB, Mask R-CNN. IEEE International Conference on Computer Vision (ICCV), vol. 2017; 2017. p. 2980–8.

    Book  Google Scholar 

  28. Möller I, Janta I, Backhaus M, Ohrndorf S, Bong DA, Martinoli C, et al. The 2017 EULAR standardised procedures for ultrasound imaging in rheumatology. Ann Rheum Dis. 2017;76:1974–9. https://0-doi-org.brum.beds.ac.uk/10.1136/annrheumdis-2017-211585.

    Article  PubMed  Google Scholar 

  29. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. IEEE Confer Comput Vision Pattern Recogn (CVPR). 2016;2016:770–8.

    Google Scholar 

  30. Lin T, Dollár P, Girshick RB, He K, Hariharan B, Belongie SJ. Feature pyramid networks for object detection. IEEE Conference Comput Vision Pattern Recogn (CVPR). 2017;2017:936–44.

    Google Scholar 

  31. Lin T, Maire M, Belongie S, Hays J, Perona P, Ramanan D, et al. Microsoft coco: Common objects in context. In European Conference on Computer Vision. Cham: Springer; 2014. p. 740–55.

    Google Scholar 

  32. Grassi W, Filippucci E. A brief history of ultrasound in rheumatology: where we were. Clin Exp Rheumatol. 2014;32(1 Suppl 80):S3–6.

    PubMed  Google Scholar 

  33. Kaeley GS, Bakewell C, Deodhar A. The importance of ultrasound in identifying and differentiating patients with early inflammatory arthritis: a narrative review. Arthritis Res Ther. 2020;22:1. https://0-doi-org.brum.beds.ac.uk/10.1186/s13075-019-2050-4.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Sakellariou G, Giovannini I, Grignaschi S, Zabotti A, Iagnocco A. New developments in ultrasound in rheumatology: innovative tools and promising applications. Clin Exp Rheumatol. 2021;39:413–21.

    PubMed  Google Scholar 

  35. Silvestri E, Martinoli C, Derchi LE, Bertolotto M, Chiaramondia M, Rosenberg I. Echotexture of peripheral nerves: correlation between US and histologic findings and criteria to differentiate tendons. Radiology. 1995;197:291–6. https://0-doi-org.brum.beds.ac.uk/10.1148/radiology.197.1.7568840.

    Article  CAS  PubMed  Google Scholar 

  36. Granata G, Caliandro P, Pazzaglia C, Minciotti I, Russo G, Martinoli C. Prevalence of bifid median nerve at wrist assessed through ultrasound. Neurol Sci. 2011;32:615–8. https://0-doi-org.brum.beds.ac.uk/10.1007/s10072-011-0582-8.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

No specific funding was received from any bodies in the public, commercial, or not-for-profit sectors to carry out the work described in this manuscript.

Author information

Authors and Affiliations

Authors

Contributions

GSm, GSa, MDC, MCF, SM, and EFi made substantial contributions to the conception and design of the work. GSm, GSa, EC, EM, and EFi made substantial contributions to the acquisition, analysis, and interpretation of the data. GS, EFi, MDC, SM, EFr, and WG have drafted the work or substantively revised it.

All the authors have approved the submitted version and have agreed both to be personally accountable for the author’s own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even the ones in which the author was not personally involved, are appropriately investigated and resolved and the resolution documented in the literature.

Authors’ information

Not applicable.

Corresponding author

Correspondence to Gianluca Smerilli.

Ethics declarations

Ethics approval and consent to participate

The study was conducted in accordance with the Helsinki Declaration and was approved by the local ethics committee (Comitato Etico Regione Marche, number 262). All patients signed informed consent.

Consent for publication

Not applicable.

Competing interests

E.F. has received speaking fees from Abbvie, BMS, Janssen, Lilly, MSD, Novartis, Roche, Pfizer, and UCB Pharma. W.G. has received speaking fees from AbbVie, Celgene, Grünenthal, Pfizer, and UCB Pharma. All other authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Smerilli, G., Cipolletta, E., Sartini, G. et al. Development of a convolutional neural network for the identification and the measurement of the median nerve on ultrasound images acquired at carpal tunnel level. Arthritis Res Ther 24, 38 (2022). https://0-doi-org.brum.beds.ac.uk/10.1186/s13075-022-02729-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13075-022-02729-6