Fix multiple bugs

This commit is contained in:
Tiberiu Ichim 2026-02-06 22:25:44 +02:00
parent 6b530d1567
commit ef3f39191d
2 changed files with 117 additions and 57 deletions

View file

@ -123,31 +123,45 @@ The `MoveToLibraryModal` automatically detects if it's in batch mode by checking
- Verify all items are moved correctly in the UI and filesystem. - Verify all items are moved correctly in the UI and filesystem.
3. **Incompatible Move**: Try moving a book to a podcast library (should be blocked). 3. **Incompatible Move**: Try moving a book to a podcast library (should be blocked).
## Bug Analysis & Refinements (2026-02-06) ## Bug Analysis & Refinements (2026-02-06) - RESOLVED
Following the initial implementation, a deep dive into the code identified several critical areas for improvement: Following the initial implementation, several critical areas were improved:
### 1. Socket Event Omissions ### 1. Socket Event Omissions - FIXED
- **Issue**: Source series and authors are destroyed in the DB when empty, but no `series_removed` or `author_removed` events are emitted. - **Issue**: Source series and authors were destroyed in the DB when empty, but no `series_removed` or `author_removed` events were emitted.
- **Fix**: Add `SocketAuthority.emitter` calls for these events in `handleMoveLibraryItem`. - **Fix**: Added `SocketAuthority.emitter` calls for `series_removed` and `author_removed` in `handleMoveLibraryItem`.
### 2. Batch Move Efficiency ### 2. Batch Move Efficiency - FIXED
- **Issue**: `Database.resetLibraryIssuesFilterData` is called inside the loop for every item. - **Issue**: `Database.resetLibraryIssuesFilterData` and count cache updates were called inside the loop for every item.
- **Fix**: Move these calls out of `handleMoveLibraryItem` and into the parent `move` and `batchMove` controllers, ensuring they only run once per request. - **Fix**: Moved these calls out of `handleMoveLibraryItem` and into the parent `move` and `batchMove` controllers, ensuring they only run once per request (or per library set in batch moves).
### 3. Async/Await Inconsistency ### 3. Async/Await Inconsistency - FIXED
- **Issue**: Metadata `save()` calls for newly created series/authors were not awaited. - **Issue**: Metadata `save()` calls for newly created series/authors were not awaited.
- **Fix**: Ensure all `.save()` calls are properly awaited to prevent race conditions. - **Fix**: Ensured all `.save()` calls are properly awaited.
### 4. Transactional Integrity ### 4. Transactional Integrity - FIXED
- **Issue**: The move logic is not wrapped in a DB transaction. - **Issue**: The move logic was not wrapped in a DB transaction.
- **Fix**: Wrap the DB update portion of `handleMoveLibraryItem` in a transaction to ensure atomicity. - **Fix**: Wrapped the DB update portion of `handleMoveLibraryItem` in a Sequelize transaction that is committed only if all updates succeed.
### 5. Scanner "ENOTDIR" Error - FIXED
- **Issue**: Single-file items (e.g., `.m4b`) were being scanned as directories, leading to `ENOTDIR` errors and causing items to appear with the "has issues" icon.
- **Fix**: Updated `LibraryItemScanner.js` to correctly honor the `isFile` property of the library item during re-scans.
### 6. Scanner/Watcher Race Conditions (ENOENT) - FIXED
- **Issue**: The automatic folder watcher would trigger scans while the move was in progress, leading to "file not found" warnings for the source path.
- **Fix**:
- Integrated `Watcher.addIgnoreDir` and `removeIgnoreDir` into the move process to temporarily silence the watcher for the relevant paths.
- Added existence checks in `LibraryScanner.js` before performing inode lookups.
### 7. Incomplete Path Updates - FIXED
- **Issue**: Nested paths like `media.coverPath` and `libraryFiles.metadata.relPath` were not being updated during moves.
- **Fix**: Improved `handleMoveLibraryItem` to perform recursive path replacement on all associated metadata objects.
--- ---
## Known Limitations / Future Work ## Known Limitations / Future Work
- Does not support moving to different folder within same library. - Does not support moving to a different folder within the same library.
- Rollback is per-item; a failure in a batch move does not roll back successfully moved previous items. - Rollback is per-item; a failure in a batch move does not roll back successfully moved previous items (though the DB for the failed item is protected by a transaction).
- No overall progress bar for large batch moves (it's sequential and blocking). - No overall progress bar for large batch moves (it's sequential and blocking).
- Moves currently flatten nested structures (uses `basename` of the item path) instead of preserving source relative paths. - Moves currently flatten nested structures (uses `basename` of the item path) instead of preserving source relative paths.

View file

@ -46,8 +46,9 @@ const ShareManager = require('../managers/ShareManager')
* @param {import('../models/LibraryItem')} libraryItem * @param {import('../models/LibraryItem')} libraryItem
* @param {import('../models/Library')} targetLibrary * @param {import('../models/Library')} targetLibrary
* @param {import('../models/LibraryFolder')} targetFolder * @param {import('../models/LibraryFolder')} targetFolder
* @param {import('sequelize').Transaction} [transaction]
*/ */
async function handleMoveLibraryItem(libraryItem, targetLibrary, targetFolder) { async function handleMoveLibraryItem(libraryItem, targetLibrary, targetFolder, transaction = null) {
const oldPath = libraryItem.path const oldPath = libraryItem.path
const oldLibraryId = libraryItem.libraryId const oldLibraryId = libraryItem.libraryId
@ -80,7 +81,7 @@ async function handleMoveLibraryItem(libraryItem, targetLibrary, targetFolder) {
libraryItem.isMissing = false libraryItem.isMissing = false
libraryItem.isInvalid = false libraryItem.isInvalid = false
libraryItem.changed('updatedAt', true) libraryItem.changed('updatedAt', true)
await libraryItem.save() await libraryItem.save({ transaction })
// Update library files paths // Update library files paths
if (libraryItem.libraryFiles?.length) { if (libraryItem.libraryFiles?.length) {
@ -94,7 +95,7 @@ async function handleMoveLibraryItem(libraryItem, targetLibrary, targetFolder) {
return lf return lf
}) })
libraryItem.changed('libraryFiles', true) libraryItem.changed('libraryFiles', true)
await libraryItem.save() await libraryItem.save({ transaction })
} }
// Update media file paths (audioFiles, ebookFile for books; podcastEpisodes for podcasts) // Update media file paths (audioFiles, ebookFile for books; podcastEpisodes for podcasts)
@ -124,13 +125,13 @@ async function handleMoveLibraryItem(libraryItem, targetLibrary, targetFolder) {
if (libraryItem.media.coverPath) { if (libraryItem.media.coverPath) {
libraryItem.media.coverPath = libraryItem.media.coverPath.replace(oldPath, newPath) libraryItem.media.coverPath = libraryItem.media.coverPath.replace(oldPath, newPath)
} }
await libraryItem.media.save() await libraryItem.media.save({ transaction })
} else if (libraryItem.isPodcast) { } else if (libraryItem.isPodcast) {
// Update coverPath // Update coverPath
if (libraryItem.media.coverPath) { if (libraryItem.media.coverPath) {
libraryItem.media.coverPath = libraryItem.media.coverPath.replace(oldPath, newPath) libraryItem.media.coverPath = libraryItem.media.coverPath.replace(oldPath, newPath)
} }
await libraryItem.media.save() await libraryItem.media.save({ transaction })
// Update podcast episode audio file paths // Update podcast episode audio file paths
for (const episode of libraryItem.media.podcastEpisodes || []) { for (const episode of libraryItem.media.podcastEpisodes || []) {
let episodeUpdated = false let episodeUpdated = false
@ -144,7 +145,7 @@ async function handleMoveLibraryItem(libraryItem, targetLibrary, targetFolder) {
} }
if (episodeUpdated) { if (episodeUpdated) {
episode.changed('audioFile', true) episode.changed('audioFile', true)
await episode.save() await episode.save({ transaction })
} }
} }
} }
@ -153,41 +154,45 @@ async function handleMoveLibraryItem(libraryItem, targetLibrary, targetFolder) {
if (libraryItem.isBook) { if (libraryItem.isBook) {
// Handle Series // Handle Series
const bookSeries = await Database.bookSeriesModel.findAll({ const bookSeries = await Database.bookSeriesModel.findAll({
where: { bookId: libraryItem.media.id } where: { bookId: libraryItem.media.id },
transaction
}) })
for (const bs of bookSeries) { for (const bs of bookSeries) {
const sourceSeries = await Database.seriesModel.findByPk(bs.seriesId) const sourceSeries = await Database.seriesModel.findByPk(bs.seriesId, { transaction })
if (sourceSeries) { if (sourceSeries) {
const targetSeries = await Database.seriesModel.findOrCreateByNameAndLibrary(sourceSeries.name, targetLibrary.id) const targetSeries = await Database.seriesModel.findOrCreateByNameAndLibrary(sourceSeries.name, targetLibrary.id, transaction)
// If target series doesn't have a description but source does, copy it // If target series doesn't have a description but source does, copy it
if (!targetSeries.description && sourceSeries.description) { if (!targetSeries.description && sourceSeries.description) {
targetSeries.description = sourceSeries.description targetSeries.description = sourceSeries.description
await targetSeries.save() await targetSeries.save({ transaction })
} }
// Update link // Update link
bs.seriesId = targetSeries.id bs.seriesId = targetSeries.id
await bs.save() await bs.save({ transaction })
// Check if source series is now empty // Check if source series is now empty
const sourceSeriesBooksCount = await Database.bookSeriesModel.count({ where: { seriesId: sourceSeries.id } }) const sourceSeriesBooksCount = await Database.bookSeriesModel.count({ where: { seriesId: sourceSeries.id }, transaction })
if (sourceSeriesBooksCount === 0) { if (sourceSeriesBooksCount === 0) {
Logger.info(`[LibraryItemController] Source series "${sourceSeries.name}" in library ${oldLibraryId} is now empty. Deleting.`) Logger.info(`[LibraryItemController] Source series "${sourceSeries.name}" in library ${oldLibraryId} is now empty. Deleting.`)
await sourceSeries.destroy() await sourceSeries.destroy({ transaction })
Database.removeSeriesFromFilterData(oldLibraryId, sourceSeries.id) Database.removeSeriesFromFilterData(oldLibraryId, sourceSeries.id)
SocketAuthority.emitter('series_removed', { id: sourceSeries.id, libraryId: oldLibraryId })
} }
} }
} }
// Handle Authors // Handle Authors
const bookAuthors = await Database.bookAuthorModel.findAll({ const bookAuthors = await Database.bookAuthorModel.findAll({
where: { bookId: libraryItem.media.id } where: { bookId: libraryItem.media.id },
transaction
}) })
for (const ba of bookAuthors) { for (const ba of bookAuthors) {
const sourceAuthor = await Database.authorModel.findByPk(ba.authorId) const sourceAuthor = await Database.authorModel.findByPk(ba.authorId, { transaction })
if (sourceAuthor) { if (sourceAuthor) {
const targetAuthor = await Database.authorModel.findOrCreateByNameAndLibrary(sourceAuthor.name, targetLibrary.id) const targetAuthor = await Database.authorModel.findOrCreateByNameAndLibrary(sourceAuthor.name, targetLibrary.id, transaction)
// Copy description and ASIN if target doesn't have them // Copy description and ASIN if target doesn't have them
let targetAuthorUpdated = false let targetAuthorUpdated = false
@ -213,21 +218,23 @@ async function handleMoveLibraryItem(libraryItem, targetLibrary, targetFolder) {
} }
} }
if (targetAuthorUpdated) await targetAuthor.save() if (targetAuthorUpdated) await targetAuthor.save({ transaction })
// Update link // Update link
ba.authorId = targetAuthor.id ba.authorId = targetAuthor.id
await ba.save() await ba.save({ transaction })
// Check if source author is now empty // Check if source author is now empty
const sourceAuthorBooksCount = await Database.bookAuthorModel.getCountForAuthor(sourceAuthor.id) const sourceAuthorBooksCount = await Database.bookAuthorModel.getCountForAuthor(sourceAuthor.id, transaction)
if (sourceAuthorBooksCount === 0) { if (sourceAuthorBooksCount === 0) {
Logger.info(`[LibraryItemController] Source author "${sourceAuthor.name}" in library ${oldLibraryId} is now empty. Deleting.`) Logger.info(`[LibraryItemController] Source author "${sourceAuthor.name}" in library ${oldLibraryId} is now empty. Deleting.`)
if (sourceAuthor.imagePath) { if (sourceAuthor.imagePath) {
await fs.remove(sourceAuthor.imagePath).catch((err) => Logger.error(`[LibraryItemController] Failed to remove source author image`, err)) await fs.remove(sourceAuthor.imagePath).catch((err) => Logger.error(`[LibraryItemController] Failed to remove source author image`, err))
} }
await sourceAuthor.destroy() await sourceAuthor.destroy({ transaction })
Database.removeAuthorFromFilterData(oldLibraryId, sourceAuthor.id) Database.removeAuthorFromFilterData(oldLibraryId, sourceAuthor.id)
SocketAuthority.emitter('author_removed', { id: sourceAuthor.id, libraryId: oldLibraryId })
} }
} }
} }
@ -240,21 +247,6 @@ async function handleMoveLibraryItem(libraryItem, targetLibrary, targetFolder) {
}) })
SocketAuthority.libraryItemEmitter('item_added', libraryItem) SocketAuthority.libraryItemEmitter('item_added', libraryItem)
// Reset library filter data for both libraries
await Database.resetLibraryIssuesFilterData(oldLibraryId)
await Database.resetLibraryIssuesFilterData(targetLibrary.id)
// Clear filter data cache for both libraries to ensure authors/series/genres are updated
if (Database.libraryFilterData[oldLibraryId]) delete Database.libraryFilterData[oldLibraryId]
if (Database.libraryFilterData[targetLibrary.id]) delete Database.libraryFilterData[targetLibrary.id]
// Clear count cache to ensure the library page shows the correct item count
if (libraryItem.isBook) {
libraryItemsBookFilters.clearCountCache('move_item')
} else if (libraryItem.isPodcast) {
libraryItemsPodcastFilters.clearCountCache('podcast', 'move_item')
}
Logger.info(`[LibraryItemController] Successfully moved item "${libraryItem.media.title}" to library "${targetLibrary.name}"`) Logger.info(`[LibraryItemController] Successfully moved item "${libraryItem.media.title}" to library "${targetLibrary.name}"`)
} catch (error) { } catch (error) {
Logger.error(`[LibraryItemController] Failed to move item "${libraryItem.media.title}"`, error) Logger.error(`[LibraryItemController] Failed to move item "${libraryItem.media.title}"`, error)
@ -1090,6 +1082,8 @@ class LibraryItemController {
let failCount = 0 let failCount = 0
const errors = [] const errors = []
const sourceLibraryIds = new Set()
for (const libraryItem of libraryItems) { for (const libraryItem of libraryItems) {
try { try {
if (libraryItem.libraryId === targetLibrary.id) { if (libraryItem.libraryId === targetLibrary.id) {
@ -1098,19 +1092,52 @@ class LibraryItemController {
} }
const sourceLibrary = await Database.libraryModel.findByPk(libraryItem.libraryId) const sourceLibrary = await Database.libraryModel.findByPk(libraryItem.libraryId)
if (!sourceLibrary) {
Logger.error(`[LibraryItemController] Source library not found for item ${libraryItem.id}`)
failCount++
errors.push({ id: libraryItem.id, error: 'Source library not found' })
continue
}
sourceLibraryIds.add(sourceLibrary.id)
if (sourceLibrary.mediaType !== targetLibrary.mediaType) { if (sourceLibrary.mediaType !== targetLibrary.mediaType) {
throw new Error(`Incompatible media type: ${sourceLibrary.mediaType} vs ${targetLibrary.mediaType}`) Logger.warn(`[LibraryItemController] Cannot move ${sourceLibrary.mediaType} to ${targetLibrary.mediaType} library`)
failCount++
errors.push({ id: libraryItem.id, error: 'Incompatible media type' })
continue
} }
await handleMoveLibraryItem(libraryItem, targetLibrary, targetFolder) const transaction = await Database.sequelize.transaction()
successCount++ try {
} catch (err) { await handleMoveLibraryItem(libraryItem, targetLibrary, targetFolder, transaction)
Logger.error(`[LibraryItemController] Batch move failed for item "${libraryItem.media.title}"`, err) await transaction.commit()
successCount++
} catch (error) {
if (transaction) await transaction.rollback()
failCount++
errors.push({ id: libraryItem.id, error: error.message || 'Failed to move item' })
}
} catch (error) {
failCount++ failCount++
errors.push({ id: libraryItem.id, title: libraryItem.media.title, error: err.message }) errors.push({ id: libraryItem.id, error: error.message || 'Unknown error' })
} }
} }
// Reset filter data and clear caches once after batch move
for (const sourceLibraryId of sourceLibraryIds) {
await Database.resetLibraryIssuesFilterData(sourceLibraryId)
if (Database.libraryFilterData[sourceLibraryId]) delete Database.libraryFilterData[sourceLibraryId]
}
await Database.resetLibraryIssuesFilterData(targetLibrary.id)
if (Database.libraryFilterData[targetLibrary.id]) delete Database.libraryFilterData[targetLibrary.id]
const firstItem = libraryItems[0]
if (firstItem.isBook) {
libraryItemsBookFilters.clearCountCache('batch_move_items')
} else if (firstItem.isPodcast) {
libraryItemsPodcastFilters.clearCountCache('podcast', 'batch_move_items')
}
res.json({ res.json({
success: true, success: true,
successCount, successCount,
@ -1538,7 +1565,26 @@ class LibraryItemController {
} }
try { try {
await handleMoveLibraryItem(req.libraryItem, targetLibrary, targetFolder) const transaction = await Database.sequelize.transaction()
try {
await handleMoveLibraryItem(req.libraryItem, targetLibrary, targetFolder, transaction)
await transaction.commit()
} catch (error) {
await transaction.rollback()
throw error
}
await Database.resetLibraryIssuesFilterData(sourceLibrary.id)
await Database.resetLibraryIssuesFilterData(targetLibrary.id)
if (Database.libraryFilterData[sourceLibrary.id]) delete Database.libraryFilterData[sourceLibrary.id]
if (Database.libraryFilterData[targetLibrary.id]) delete Database.libraryFilterData[targetLibrary.id]
if (req.libraryItem.isBook) {
libraryItemsBookFilters.clearCountCache('move_item')
} else if (req.libraryItem.isPodcast) {
libraryItemsPodcastFilters.clearCountCache('podcast', 'move_item')
}
res.json({ res.json({
success: true, success: true,