programming.dev
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
codeinabox to Software TestingEnglish · 7 days ago

Generative AI to Generate Test Data Generators

arxiv.org

external-link
message-square
0
link
fedilink
2
external-link

Generative AI to Generate Test Data Generators

arxiv.org

codeinabox to Software TestingEnglish · 7 days ago
message-square
0
link
fedilink
Generating fake data is an essential dimension of modern software testing, as demonstrated by the number and significance of data faking libraries. Yet, developers of faking libraries cannot keep up with the wide range of data to be generated for different natural languages and domains. In this paper, we assess the ability of generative AI for generating test data in different domains. We design three types of prompts for Large Language Models (LLMs), which perform test data generation tasks at different levels of integrability: 1) raw test data generation, 2) synthesizing programs in a specific language that generate useful test data, and 3) producing programs that use state-of-the-art faker libraries. We evaluate our approach by prompting LLMs to generate test data for 11 domains. The results show that LLMs can successfully generate realistic test data generators in a wide range of domains at all three levels of integrability.
alert-triangle
You must log in or # to comment.

Software Testing

software_testing

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

Spreading knowledge on software testing and the value it can provide, as well as a location to ask questions about implementations or testing strategies or frameworks

Icon base by Delapouite under CC BY 3.0 with modifications to add a gradient

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 2 users / day
  • 5 users / week
  • 22 users / month
  • 22 users / 6 months
  • 94 local subscribers
  • 271 subscribers
  • 22 Posts
  • 20 Comments
  • Modlog
  • mods:
  • Ategon
  • lackthought@lemmy.sdf.org
  • BE: 0.19.13
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org